[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:43 dist-test-slave-512q krb5kdc[505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:43 dist-test-slave-512q krb5kdc[505](info): set up 2 sockets
Sep 29 22:54:43 dist-test-slave-512q krb5kdc[505](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260929 22:54:44.610410 498 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:44 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:44.725291 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:37435
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:37435
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:44.802897 518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:44.803086 518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:44.803107 518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:44.804119 518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:44.804153 518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:44.804167 518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:44.804179 518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:44.804191 518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:44.805548 518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:37435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:37435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:44.805713 518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:44.805869 518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:44.811197 526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:44.811237 523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:44.811197 524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:44.811358 518 server_base.cc:1034] running on GCE node
I20260929 22:54:44.811708 518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:44.812031 518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:44.813192 518 hybrid_clock.cc:648] HybridClock initialized: now 1790722484813157 us; error 48 us; skew 500 ppm
Sep 29 22:54:44 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722484, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:44.819167 518 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:44.819584 518 webserver.cc:460] Webserver started at http://127.0.124.190:34079/ using document root <none> and password file <none>
I20260929 22:54:44.819808 518 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:44.819870 518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:44.820013 518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:44.821224 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "a5936070ddda4212bf821861bf8d303b"
format_stamp: "Formatted at 2026-09-29 22:54:44 on dist-test-slave-512q"
server_key: "bacfb1defc9cdd2985c18dc241848d90"
server_key_iv: "006d661f58397d83dc8cb0e37b457d84"
server_key_version: "encryptionkey@0"
I20260929 22:54:44.821622 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "a5936070ddda4212bf821861bf8d303b"
format_stamp: "Formatted at 2026-09-29 22:54:44 on dist-test-slave-512q"
server_key: "bacfb1defc9cdd2985c18dc241848d90"
server_key_iv: "006d661f58397d83dc8cb0e37b457d84"
server_key_version: "encryptionkey@0"
I20260929 22:54:44.822968 518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:54:44.823668 533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:44.823834 518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:44.823935 518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "a5936070ddda4212bf821861bf8d303b"
format_stamp: "Formatted at 2026-09-29 22:54:44 on dist-test-slave-512q"
server_key: "bacfb1defc9cdd2985c18dc241848d90"
server_key_iv: "006d661f58397d83dc8cb0e37b457d84"
server_key_version: "encryptionkey@0"
I20260929 22:54:44.824013 518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:44.850471 518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:44.852401 518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:44.852589 518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:44.856307 518 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:37435
I20260929 22:54:44.856360 585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:37435 every 8 connection(s)
I20260929 22:54:44.856703 518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:44.857520 586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:44.859647 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 518
I20260929 22:54:44.859726 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:44.859834 586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b: Bootstrap starting.
I20260929 22:54:44.860436 498 external_mini_cluster.cc:1428] Setting key 90e59bf4d6b6f703afeba7e86baea7ba
I20260929 22:54:44.860458 586 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:44.860731 586 log.cc:824] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:44.861485 586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b: No bootstrap required, opened a new log
I20260929 22:54:44.863736 586 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } }
I20260929 22:54:44.863905 586 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:44.863941 586 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5936070ddda4212bf821861bf8d303b, State: Initialized, Role: FOLLOWER
I20260929 22:54:44.864064 586 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } }
I20260929 22:54:44.864145 586 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:44.864174 586 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:44.864287 586 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:44.865336 586 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } }
I20260929 22:54:44.865449 586 leader_election.cc:302] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5936070ddda4212bf821861bf8d303b; no voters:
I20260929 22:54:44.865607 586 leader_election.cc:288] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:44.865638 591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:44.865780 591 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [term 1 LEADER]: Becoming Leader. State: Replica: a5936070ddda4212bf821861bf8d303b, State: Running, Role: LEADER
I20260929 22:54:44.865854 586 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:44.865873 591 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } }
I20260929 22:54:44.866220 591 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5936070ddda4212bf821861bf8d303b. Latest consensus state: current_term: 1 leader_uuid: "a5936070ddda4212bf821861bf8d303b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } } }
I20260929 22:54:44.866302 591 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:44.866230 593 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5936070ddda4212bf821861bf8d303b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5936070ddda4212bf821861bf8d303b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37435 } } }
I20260929 22:54:44.866389 593 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:44.867224 598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:44.867689 598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:44.869858 598 catalog_manager.cc:1347] Generated new cluster ID: 78937610c9e44b7eaa14dbbeee22a7e1
I20260929 22:54:44.869908 598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:54:44 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:44.877182 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:44.861296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58018 (local address 127.0.124.190:37435)
0929 22:54:44.861474 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:44.861483 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:44.861713 (+ 230us) server_negotiation.cc:407] Connection header received
0929 22:54:44.863936 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:44.863943 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:44.863997 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:44.864161 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:44.866442 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:44.868096 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:44.869500 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:44.869965 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:44.870072 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:44.873651 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:44.873654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:44.873655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:44.873665 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:44.875251 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:44.875712 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:44.875715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:44.875716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:44.875809 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:44.876071 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:44.876071 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:44.876072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:44.876371 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:44.876585 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:44.876832 (+ 247us) server_negotiation.cc:299] Negotiation successful
0929 22:54:44.876958 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260929 22:54:44.877584 598 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:44.878243 598 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:44.888084 598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5936070ddda4212bf821861bf8d303b: Generated new TSK 0
I20260929 22:54:44.888296 598 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:44.915766 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:44.993784 612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:44.994015 612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:44.994053 612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:44.995172 612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:44.995239 612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:44.995281 612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:44.996774 612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:44.997035 612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:44.997246 612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:45.002081 620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.002086 617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.002075 618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:45.002283 612 server_base.cc:1034] running on GCE node
I20260929 22:54:45.002496 612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:45.002687 612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:45.003844 612 hybrid_clock.cc:648] HybridClock initialized: now 1790722485003836 us; error 39 us; skew 500 ppm
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:45.006259 612 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:45.006706 612 webserver.cc:460] Webserver started at http://127.0.124.129:38137/ using document root <none> and password file <none>
I20260929 22:54:45.006927 612 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:45.007000 612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:45.007170 612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:45.008323 612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "44ab737c718343ac9b7955f1b48e7f8b"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "2556de17614d617d39a1ea090a4fa2e6"
server_key_iv: "a5553639647ffdd5c7d1e95b4537eaf9"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.008687 612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "44ab737c718343ac9b7955f1b48e7f8b"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "2556de17614d617d39a1ea090a4fa2e6"
server_key_iv: "a5553639647ffdd5c7d1e95b4537eaf9"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.010102 612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:45.010838 627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.011003 612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:45.011101 612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "44ab737c718343ac9b7955f1b48e7f8b"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "2556de17614d617d39a1ea090a4fa2e6"
server_key_iv: "a5553639647ffdd5c7d1e95b4537eaf9"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.011186 612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:45.034176 612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:45.035975 612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:45.036149 612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:45.036404 612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:45.036715 612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:45.036767 612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.036800 612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:45.036844 612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.042402 612 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:40989
I20260929 22:54:45.042467 741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:40989 every 8 connection(s)
I20260929 22:54:45.042729 612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:45.050233 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 612
I20260929 22:54:45.050344 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:54:45.050544 498 external_mini_cluster.cc:1428] Setting key 0f7cf43d4b674b57138bc023206588cc
I20260929 22:54:45.051848 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.043360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:37435 (local address 127.0.124.129:47679)
0929 22:54:45.043535 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:45.043584 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:45.044065 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:45.044341 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:45.044345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:45.044956 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:45.045134 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.045138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.045813 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.045814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.046571 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.046573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.046961 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.046962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.047083 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.047473 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:45.047480 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:45.048810 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:45.050420 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.050427 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.050429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.050708 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.050908 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.050909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.050909 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.051060 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.051353 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:45.051358 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:45.051470 (+ 112us) client_negotiation.cc:769] Sending connection context
0929 22:54:45.051560 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:54:45.051674 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260929 22:54:45.051863 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.043399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:47679 (local address 127.0.124.190:37435)
0929 22:54:45.043507 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:45.043509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:45.043669 (+ 160us) server_negotiation.cc:407] Connection header received
0929 22:54:45.044165 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:45.044166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:45.044180 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:45.044273 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:45.045233 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.045724 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.046669 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.046867 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.046948 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.048891 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:45.048892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:45.048892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:45.048898 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:45.050313 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.050789 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.050790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.050791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.050854 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.051131 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.051132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.051132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.051283 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:45.051359 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:45.051608 (+ 249us) server_negotiation.cc:299] Negotiation successful
0929 22:54:45.051716 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260929 22:54:45.052659 742 heartbeater.cc:347] Connected to a master server at 127.0.124.190:37435
I20260929 22:54:45.052768 742 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:45.052955 742 heartbeater.cc:511] Master 127.0.124.190:37435 requested a full tablet report, sending...
I20260929 22:54:45.053491 550 ts_manager.cc:194] Registered new tserver with Master: 44ab737c718343ac9b7955f1b48e7f8b (127.0.124.129:40989)
I20260929 22:54:45.054355 550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:47679
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:54:45.076160 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:45.155052 747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:45.155278 747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:45.155313 747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:45.156508 747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:45.156566 747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:45.156610 747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:54:45.158003 747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:45.158255 747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:45.158469 747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:45.163228 753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.163228 752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.163465 755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:45.163456 747 server_base.cc:1034] running on GCE node
I20260929 22:54:45.163743 747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:45.164021 747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:45.165175 747 hybrid_clock.cc:648] HybridClock initialized: now 1790722485165152 us; error 44 us; skew 500 ppm
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:45.167703 747 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:54:45.168156 747 webserver.cc:460] Webserver started at http://127.0.124.130:40467/ using document root <none> and password file <none>
I20260929 22:54:45.168388 747 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:45.168459 747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:45.168586 747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:45.169593 747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "b08e63206e2e41a3b30107dfb46f483c"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "beeb107014c0894e2c95b69b73e51a33"
server_key_iv: "3b6b33a8fee1e1e7fe5deb8c260f0f84"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.169947 747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "b08e63206e2e41a3b30107dfb46f483c"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "beeb107014c0894e2c95b69b73e51a33"
server_key_iv: "3b6b33a8fee1e1e7fe5deb8c260f0f84"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.171276 747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:54:45.171953 762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.172125 747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:45.172247 747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "b08e63206e2e41a3b30107dfb46f483c"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "beeb107014c0894e2c95b69b73e51a33"
server_key_iv: "3b6b33a8fee1e1e7fe5deb8c260f0f84"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.172334 747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:45.183393 747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:45.185211 747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:45.185376 747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:45.185585 747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:45.185909 747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:45.185963 747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.186018 747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:45.186074 747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.191911 747 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:42341
I20260929 22:54:45.191953 875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:42341 every 8 connection(s)
I20260929 22:54:45.192359 747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:45.200655 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.192981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:43509 (local address 127.0.124.190:37435)
0929 22:54:45.193021 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:45.193023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:45.193190 (+ 167us) server_negotiation.cc:407] Connection header received
0929 22:54:45.193621 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:45.193622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:45.193630 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:45.193685 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:45.194527 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.195026 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.195930 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.196128 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.196180 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.198163 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:45.198165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:45.198165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:45.198172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:45.199423 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.199765 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.199765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.199766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.199812 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.200009 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.200009 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.200010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.200118 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:45.200167 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:45.200447 (+ 280us) server_negotiation.cc:299] Negotiation successful
0929 22:54:45.200552 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:54:45.200644 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 747
I20260929 22:54:45.200716 878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.192932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:37435 (local address 127.0.124.130:43509)
0929 22:54:45.193076 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:45.193114 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:45.193544 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:45.193732 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:45.193735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:45.194275 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:45.194448 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.194452 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.195109 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.195109 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.195858 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.195859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.196198 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.196199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.196349 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.196745 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:45.196752 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:45.198079 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:45.199497 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.199502 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.199504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.199702 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.199867 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.199867 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.199868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.199955 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.200178 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:45.200181 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:45.200337 (+ 156us) client_negotiation.cc:769] Sending connection context
0929 22:54:45.200422 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:54:45.200541 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":84,"threads_started":1}
I20260929 22:54:45.200732 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:54:45.200908 498 external_mini_cluster.cc:1428] Setting key 94c13a5a3eeaa36406bf9cb159cf3019
I20260929 22:54:45.201208 876 heartbeater.cc:347] Connected to a master server at 127.0.124.190:37435
I20260929 22:54:45.201297 876 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:45.201457 876 heartbeater.cc:511] Master 127.0.124.190:37435 requested a full tablet report, sending...
I20260929 22:54:45.201882 550 ts_manager.cc:194] Registered new tserver with Master: b08e63206e2e41a3b30107dfb46f483c (127.0.124.130:42341)
I20260929 22:54:45.202301 550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:43509
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:54:45.225045 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:45.306872 881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:45.307061 881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:45.307085 881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:45.308306 881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:45.308346 881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:45.308372 881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:54:45.309886 881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:37435
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:45.310058 881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:45.310261 881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:45.315173 886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.315167 887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:45.315169 889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:45.315450 881 server_base.cc:1034] running on GCE node
I20260929 22:54:45.315702 881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:45.315956 881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:45.317142 881 hybrid_clock.cc:648] HybridClock initialized: now 1790722485317119 us; error 36 us; skew 500 ppm
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:45.319715 881 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:54:45.320118 881 webserver.cc:460] Webserver started at http://127.0.124.131:41329/ using document root <none> and password file <none>
I20260929 22:54:45.320413 881 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:45.320484 881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:45.320629 881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:45.321687 881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "6dd5f18bd0e84a558f43cdd4580851d5"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "0efed9409a85e1e4b1f29ac5f84dba6e"
server_key_iv: "b08796109f1f34680299965055987a68"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.322060 881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "6dd5f18bd0e84a558f43cdd4580851d5"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "0efed9409a85e1e4b1f29ac5f84dba6e"
server_key_iv: "b08796109f1f34680299965055987a68"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.323535 881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:54:45.324366 896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.324556 881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:45.324646 881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "6dd5f18bd0e84a558f43cdd4580851d5"
format_stamp: "Formatted at 2026-09-29 22:54:45 on dist-test-slave-512q"
server_key: "0efed9409a85e1e4b1f29ac5f84dba6e"
server_key_iv: "b08796109f1f34680299965055987a68"
server_key_version: "encryptionkey@0"
I20260929 22:54:45.324738 881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:45.338640 881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:45.340602 881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:45.340765 881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:45.340998 881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:45.341339 881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:45.341403 881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.341447 881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:45.341480 881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:45.347625 881 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:38567
I20260929 22:54:45.347664 1011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:38567 every 8 connection(s)
I20260929 22:54:45.348034 881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:54:45.349973 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 881
I20260929 22:54:45.350087 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:54:45.350299 498 external_mini_cluster.cc:1428] Setting key 24d4f36ab0afcbce9bd8b0efd2679044
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:45.357726 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.348823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:43665 (local address 127.0.124.190:37435)
0929 22:54:45.348864 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:45.348867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:45.349067 (+ 200us) server_negotiation.cc:407] Connection header received
0929 22:54:45.349558 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:45.349559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:45.349569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:45.349630 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:45.350701 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.351494 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.352564 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.352768 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.352837 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.354958 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:45.354959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:45.354959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:45.354966 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:45.356461 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.356876 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.356877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.356877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.356932 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.357167 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.357168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.357168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.357278 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:45.357342 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:45.357605 (+ 263us) server_negotiation.cc:299] Negotiation successful
0929 22:54:45.357666 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:54:45.357973 1014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.348770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:37435 (local address 127.0.124.131:43665)
0929 22:54:45.348933 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:45.348975 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:45.349465 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:45.349693 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:45.349696 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:45.350424 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:45.350627 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.350632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.351569 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.351570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.352467 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:45.352469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.352859 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.352859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:45.352972 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.353520 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:45.353528 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:45.354848 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:45.356528 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.356534 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.356535 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.356742 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.356994 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:45.356994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:45.356994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:45.357086 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:45.357367 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:45.357372 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:45.357479 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 22:54:45.357571 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:54:45.357692 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260929 22:54:45.358546 1012 heartbeater.cc:347] Connected to a master server at 127.0.124.190:37435
I20260929 22:54:45.358649 1012 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:45.358812 1012 heartbeater.cc:511] Master 127.0.124.190:37435 requested a full tablet report, sending...
I20260929 22:54:45.359148 550 ts_manager.cc:194] Registered new tserver with Master: 6dd5f18bd0e84a558f43cdd4580851d5 (127.0.124.131:38567)
I20260929 22:54:45.359537 550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:43665
I20260929 22:54:45.362259 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:45.385506 1019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.378034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.0.124.129:40989)
0929 22:54:45.378196 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:45.378201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:45.378210 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:54:45.378235 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:45.378237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:45.378250 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:45.378318 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:45.378765 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.379539 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.380271 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.380680 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.380747 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.382910 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:45.382917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:45.382917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:45.382923 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:45.384407 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.384722 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.384724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.384725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.384778 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.384933 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.384934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.384934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.385053 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:45.385152 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:45.385213 (+ 61us) server_negotiation.cc:299] Negotiation successful
0929 22:54:45.385285 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
W20260929 22:54:45.385960 655 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:45.406489 1019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:45.400314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36922 (local address 127.0.124.129:40989)
0929 22:54:45.400366 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:45.400368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:45.400462 (+ 94us) server_negotiation.cc:407] Connection header received
0929 22:54:45.400484 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:45.400485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:45.400495 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:45.400543 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:45.401038 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.401504 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.402168 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:45.402368 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:45.402416 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:45.404379 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:45.404380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:45.404381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:45.404387 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:45.405712 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.405958 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.405958 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.405958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.405998 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:45.406127 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:45.406128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:45.406128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:45.406211 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:45.406283 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:45.406341 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 22:54:45.406392 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:54:45.407054 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 612
I20260929 22:54:45.411996 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 747
I20260929 22:54:45.416194 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 881
I20260929 22:54:45.420188 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 518
2026-09-29T22:54:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1853 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[1026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[1026](info): set up 2 sockets
Sep 29 22:54:45 dist-test-slave-512q krb5kdc[1026](info): commencing operation
krb5kdc: starting...
W20260929 22:54:46.445925 498 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:46.559161 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34479
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:46.642324 1039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:46.642554 1039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:46.642613 1039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:46.643700 1039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:46.643767 1039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:46.643791 1039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:46.643817 1039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:46.643865 1039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:46.645335 1039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:46.645642 1039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:46.645857 1039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:46.650722 1044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:46.650815 1045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:46.650846 1039 server_base.cc:1034] running on GCE node
W20260929 22:54:46.650801 1047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:46.651188 1039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:46.651463 1039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:46.652604 1039 hybrid_clock.cc:648] HybridClock initialized: now 1790722486652582 us; error 34 us; skew 500 ppm
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:46.654982 1039 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:46.655395 1039 webserver.cc:460] Webserver started at http://127.0.124.190:34567/ using document root <none> and password file <none>
I20260929 22:54:46.655632 1039 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:46.655702 1039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:46.655856 1039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:46.656919 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "1488621a075a424e83cf132d1c44bf47"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "f9edefcd11745f6ff0305029854bdcdb"
server_key_iv: "5f85bb45785525b379634ad6f760c271"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.657292 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "1488621a075a424e83cf132d1c44bf47"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "f9edefcd11745f6ff0305029854bdcdb"
server_key_iv: "5f85bb45785525b379634ad6f760c271"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.658689 1039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:54:46.659396 1054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:46.659569 1039 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:46.659672 1039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "1488621a075a424e83cf132d1c44bf47"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "f9edefcd11745f6ff0305029854bdcdb"
server_key_iv: "5f85bb45785525b379634ad6f760c271"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.659757 1039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:46.676636 1039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:46.678469 1039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:46.678658 1039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:46.682552 1039 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:34479
I20260929 22:54:46.682658 1106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:34479 every 8 connection(s)
I20260929 22:54:46.682963 1039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:46.683466 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1039
I20260929 22:54:46.683542 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:46.683717 498 external_mini_cluster.cc:1428] Setting key d3c7c5e73b5e7545da1a7a03af61f6f1
I20260929 22:54:46.684044 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:46.687306 1107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47: Bootstrap starting.
I20260929 22:54:46.687908 1107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:46.688225 1107 log.cc:824] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:46.688913 1107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47: No bootstrap required, opened a new log
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:46.690721 1107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } }
I20260929 22:54:46.690877 1107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:46.690923 1107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1488621a075a424e83cf132d1c44bf47, State: Initialized, Role: FOLLOWER
I20260929 22:54:46.691056 1107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } }
I20260929 22:54:46.691149 1107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:46.691196 1107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:46.691243 1107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:46.691738 1107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } }
I20260929 22:54:46.691854 1107 leader_election.cc:302] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1488621a075a424e83cf132d1c44bf47; no voters:
I20260929 22:54:46.692018 1107 leader_election.cc:288] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:46.692094 1112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:46.692293 1112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [term 1 LEADER]: Becoming Leader. State: Replica: 1488621a075a424e83cf132d1c44bf47, State: Running, Role: LEADER
I20260929 22:54:46.692401 1107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:46.692443 1112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } }
I20260929 22:54:46.692811 1112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1488621a075a424e83cf132d1c44bf47. Latest consensus state: current_term: 1 leader_uuid: "1488621a075a424e83cf132d1c44bf47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } } }
I20260929 22:54:46.692819 1113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1488621a075a424e83cf132d1c44bf47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1488621a075a424e83cf132d1c44bf47" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34479 } } }
I20260929 22:54:46.692983 1113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:46.693192 1112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:46.693645 1121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:46.694212 1121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:46.695165 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:46.684302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53326 (local address 127.0.124.190:34479)
0929 22:54:46.684536 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:46.684544 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:46.684578 (+ 34us) server_negotiation.cc:407] Connection header received
0929 22:54:46.685210 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:46.685219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:46.685291 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:46.685450 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:46.685979 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.687286 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.688126 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.688671 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.688793 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:46.691081 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:46.691084 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:46.691084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:46.691094 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:46.693153 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:46.693598 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:46.693602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:46.693602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:46.693726 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:46.694021 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:46.694021 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:46.694022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:46.694320 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:46.694458 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:46.694878 (+ 420us) server_negotiation.cc:299] Negotiation successful
0929 22:54:46.694996 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
I20260929 22:54:46.695945 1121 catalog_manager.cc:1347] Generated new cluster ID: 1df42f8ea68845648e7f9267b59c1577
I20260929 22:54:46.695999 1121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:54:46.715164 1121 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:46.715677 1121 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:46.717662 1121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1488621a075a424e83cf132d1c44bf47: Generated new TSK 0
I20260929 22:54:46.717826 1121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:46.742654 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:46.821406 1134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:46.821655 1134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:46.821692 1134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:46.822829 1134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:46.822897 1134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:46.822940 1134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:46.824388 1134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:46.824637 1134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:46.824870 1134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:46.829614 1140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:46.829684 1134 server_base.cc:1034] running on GCE node
W20260929 22:54:46.829622 1142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:46.829612 1139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:46.830056 1134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:46.830319 1134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:46.831465 1134 hybrid_clock.cc:648] HybridClock initialized: now 1790722486831445 us; error 31 us; skew 500 ppm
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:46.833999 1134 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:46.834396 1134 webserver.cc:460] Webserver started at http://127.0.124.129:39467/ using document root <none> and password file <none>
I20260929 22:54:46.834607 1134 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:46.834650 1134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:46.834818 1134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:46.835780 1134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "0ab1ba9c25094c2795d58692b712700c"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "350eec9d80f68e2853192b5a76a62bd7"
server_key_iv: "8673985efe05240565f2312004044b34"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.836171 1134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "0ab1ba9c25094c2795d58692b712700c"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "350eec9d80f68e2853192b5a76a62bd7"
server_key_iv: "8673985efe05240565f2312004044b34"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.837530 1134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:54:46.838189 1149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:46.838378 1134 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:54:46.838445 1134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "0ab1ba9c25094c2795d58692b712700c"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "350eec9d80f68e2853192b5a76a62bd7"
server_key_iv: "8673985efe05240565f2312004044b34"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.838531 1134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:46.864156 1134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:46.866505 1134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:46.866613 1134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:46.866850 1134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:46.867201 1134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:46.867249 1134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:46.867272 1134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:46.867316 1134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:46.872658 1134 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45863
I20260929 22:54:46.872722 1263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45863 every 8 connection(s)
I20260929 22:54:46.873061 1134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:54:46.877431 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1134
I20260929 22:54:46.877565 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:54:46.877723 498 external_mini_cluster.cc:1428] Setting key 1f24c6b7aadca402793301705c8c01fd
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:46.882494 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:46.873764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:47129 (local address 127.0.124.190:34479)
0929 22:54:46.873805 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:46.873807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:46.874005 (+ 198us) server_negotiation.cc:407] Connection header received
0929 22:54:46.874445 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:46.874446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:46.874454 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:46.874521 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:46.875362 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.875842 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.876839 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.877028 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.877076 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:46.879569 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:46.879570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:46.879571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:46.879576 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:46.881044 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:46.881508 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:46.881509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:46.881510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:46.881556 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:46.881839 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:46.881840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:46.881840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:46.881980 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:46.882047 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:46.882370 (+ 323us) server_negotiation.cc:299] Negotiation successful
0929 22:54:46.882430 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:54:46.882769 1266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:46.873717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34479 (local address 127.0.124.129:47129)
0929 22:54:46.873862 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:46.873901 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:46.874365 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:46.874574 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:46.874577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:46.875111 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:46.875287 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:46.875291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.875917 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.875918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:46.876765 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:46.876768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:46.877095 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:46.877096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:46.877187 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:46.877692 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:46.877703 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:46.879486 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:46.881116 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:46.881122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:46.881124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:46.881435 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:46.881612 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:46.881613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:46.881614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:46.881753 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:46.882064 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:46.882070 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:46.882231 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 22:54:46.882351 (+ 120us) client_negotiation.cc:240] Negotiation successful
0929 22:54:46.882514 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260929 22:54:46.883317 1264 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34479
I20260929 22:54:46.883435 1264 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:46.883610 1264 heartbeater.cc:511] Master 127.0.124.190:34479 requested a full tablet report, sending...
I20260929 22:54:46.884105 1071 ts_manager.cc:194] Registered new tserver with Master: 0ab1ba9c25094c2795d58692b712700c (127.0.124.129:45863)
I20260929 22:54:46.884704 1071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:47129
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:54:46.901095 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:46.979930 1269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:46.980165 1269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:46.980202 1269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:46.981350 1269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:46.981417 1269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:46.981462 1269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:54:46.982867 1269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:46.983124 1269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:46.983351 1269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:46.988153 1274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:46.988158 1277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:46.988188 1275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:46.988484 1269 server_base.cc:1034] running on GCE node
I20260929 22:54:46.988688 1269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:46.988912 1269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:46.990067 1269 hybrid_clock.cc:648] HybridClock initialized: now 1790722486990052 us; error 25 us; skew 500 ppm
Sep 29 22:54:46 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:46.992502 1269 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:54:46.992919 1269 webserver.cc:460] Webserver started at http://127.0.124.130:42933/ using document root <none> and password file <none>
I20260929 22:54:46.993147 1269 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:46.993270 1269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:46.993430 1269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:46.994457 1269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "3721f1eea61b4e38ac30c27c048c442f"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "ebbc571cb106216b2a33c6b6a73eb75f"
server_key_iv: "a08998533648e5d545737ff25cad1b6c"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.994836 1269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "3721f1eea61b4e38ac30c27c048c442f"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "ebbc571cb106216b2a33c6b6a73eb75f"
server_key_iv: "a08998533648e5d545737ff25cad1b6c"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.996181 1269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:54:46.996939 1284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:46.997107 1269 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:46.997207 1269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "3721f1eea61b4e38ac30c27c048c442f"
format_stamp: "Formatted at 2026-09-29 22:54:46 on dist-test-slave-512q"
server_key: "ebbc571cb106216b2a33c6b6a73eb75f"
server_key_iv: "a08998533648e5d545737ff25cad1b6c"
server_key_version: "encryptionkey@0"
I20260929 22:54:46.997275 1269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:47.015347 1269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:47.017362 1269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:47.017529 1269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:47.017756 1269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:47.018064 1269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:47.018117 1269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.018159 1269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:47.018188 1269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.023752 1269 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:43375
I20260929 22:54:47.023844 1398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:43375 every 8 connection(s)
I20260929 22:54:47.024145 1269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:54:47.025308 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1269
I20260929 22:54:47.025377 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:54:47.025556 498 external_mini_cluster.cc:1428] Setting key c1967d369b2c0b410019ec9c8d149d75
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:54:47.035297 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.024881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:56937 (local address 127.0.124.190:34479)
0929 22:54:47.024930 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.024933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.025154 (+ 221us) server_negotiation.cc:407] Connection header received
0929 22:54:47.025750 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.025751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.025765 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.025860 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.026942 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.027880 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.029157 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.029421 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.029508 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.032150 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.032152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.032153 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.032162 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.033878 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.034293 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.034295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.034295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.034355 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.034614 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.034615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.034615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.034730 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.034830 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.035116 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.035205 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:54:47.035482 1401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.024862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34479 (local address 127.0.124.130:56937)
0929 22:54:47.025011 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.025046 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.025629 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.025952 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.025956 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.026663 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:47.026844 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.026848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.028014 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.028015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.029034 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.029037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.029523 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.029524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.029685 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.030271 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:47.030281 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:47.032017 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:47.033973 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:47.033979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:47.033982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:47.034214 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:47.034427 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:47.034428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:47.034429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:47.034540 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:47.034833 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:47.034839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:47.034982 (+ 143us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.035097 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.035251 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
I20260929 22:54:47.035979 1399 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34479
I20260929 22:54:47.036074 1399 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
I20260929 22:54:47.036301 1399 heartbeater.cc:511] Master 127.0.124.190:34479 requested a full tablet report, sending...
I20260929 22:54:47.036686 1071 ts_manager.cc:194] Registered new tserver with Master: 3721f1eea61b4e38ac30c27c048c442f (127.0.124.130:43375)
I20260929 22:54:47.037063 1071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:56937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:54:47.050272 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:47.128772 1404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:47.128959 1404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:47.128983 1404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:47.130062 1404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:47.130095 1404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:47.130133 1404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:54:47.131454 1404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:47.131628 1404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:47.131788 1404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:47.136567 1409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:47.136587 1410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:47.136579 1412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:47.136842 1404 server_base.cc:1034] running on GCE node
I20260929 22:54:47.137077 1404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:47.137321 1404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:47.138463 1404 hybrid_clock.cc:648] HybridClock initialized: now 1790722487138443 us; error 35 us; skew 500 ppm
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:47.140946 1404 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:54:47.141398 1404 webserver.cc:460] Webserver started at http://127.0.124.131:38931/ using document root <none> and password file <none>
I20260929 22:54:47.141625 1404 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:47.141669 1404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:47.141822 1404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:47.142802 1404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "34b95fb58fc744ffa87350b2624d5402"
format_stamp: "Formatted at 2026-09-29 22:54:47 on dist-test-slave-512q"
server_key: "7388e7d39129eabebe080622724ef0f6"
server_key_iv: "5aeee398e5227572ae9dc0ec488c6a12"
server_key_version: "encryptionkey@0"
I20260929 22:54:47.143149 1404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "34b95fb58fc744ffa87350b2624d5402"
format_stamp: "Formatted at 2026-09-29 22:54:47 on dist-test-slave-512q"
server_key: "7388e7d39129eabebe080622724ef0f6"
server_key_iv: "5aeee398e5227572ae9dc0ec488c6a12"
server_key_version: "encryptionkey@0"
I20260929 22:54:47.144466 1404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:54:47.145108 1419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.145275 1404 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.145337 1404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "34b95fb58fc744ffa87350b2624d5402"
format_stamp: "Formatted at 2026-09-29 22:54:47 on dist-test-slave-512q"
server_key: "7388e7d39129eabebe080622724ef0f6"
server_key_iv: "5aeee398e5227572ae9dc0ec488c6a12"
server_key_version: "encryptionkey@0"
I20260929 22:54:47.145419 1404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:47.164602 1404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:47.166272 1404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:47.166417 1404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:47.166635 1404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:47.166903 1404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:47.166934 1404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.166975 1404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:47.167001 1404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:47.172683 1404 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:41963
I20260929 22:54:47.172737 1533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:41963 every 8 connection(s)
I20260929 22:54:47.173015 1404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:54:47.174723 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1404
I20260929 22:54:47.174830 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:54:47.174980 498 external_mini_cluster.cc:1428] Setting key 59a2cdf9bb03c09494222c085864dadc
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:47.181607 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.173650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44829 (local address 127.0.124.190:34479)
0929 22:54:47.173696 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.173699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.173929 (+ 230us) server_negotiation.cc:407] Connection header received
0929 22:54:47.174364 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.174365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.174375 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.174427 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.175469 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.175966 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.177163 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.177358 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.177428 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.179377 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.179378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.179379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.179385 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.180533 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.180878 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.180879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.180880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.180925 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.181122 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.181122 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.181123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.181215 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.181276 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.181484 (+ 208us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.181544 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:54:47.181761 1537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.173657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34479 (local address 127.0.124.131:44829)
0929 22:54:47.173818 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.173851 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.174289 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.174499 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.174503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.175155 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:47.175383 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.175388 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.176064 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.176065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.177093 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.177095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.177444 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.177444 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.177542 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.177979 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:47.177986 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:47.179297 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:47.180594 (+ 1297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:47.180599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:47.180601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:47.180815 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:47.180980 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:47.180981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:47.180981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:47.181068 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:47.181279 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:47.181282 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:47.181380 (+ 98us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.181457 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.181561 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260929 22:54:47.182235 1535 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34479
I20260929 22:54:47.182305 1535 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:47.182482 1535 heartbeater.cc:511] Master 127.0.124.190:34479 requested a full tablet report, sending...
I20260929 22:54:47.182869 1071 ts_manager.cc:194] Registered new tserver with Master: 34b95fb58fc744ffa87350b2624d5402 (127.0.124.131:41963)
I20260929 22:54:47.183192 1071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:44829
I20260929 22:54:47.187352 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:54:47.194574 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.188987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.0.124.190:34479)
0929 22:54:47.189051 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.189053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.189163 (+ 110us) server_negotiation.cc:407] Connection header received
0929 22:54:47.189196 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.189197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.189204 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.189253 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.189734 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.190204 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.190858 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.191028 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.191074 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.192127 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.192128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.192129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.192134 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.193457 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.193839 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.193840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.193840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.193899 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.194073 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.194073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.194073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.194208 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.194296 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.194382 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.194449 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:54:47.196703 1071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:47.198211 1071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:47.204485 1546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:43375 (local address 127.0.0.1:38208)
0929 22:54:47.200813 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.200824 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.200880 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.201218 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.201219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.201221 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:47.201280 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.201282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.202224 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.202225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.203358 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.203360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.204180 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.204181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.204277 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.204292 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.204364 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.204410 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260929 22:54:47.204540 1547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38208 (local address 127.0.124.130:43375)
0929 22:54:47.201031 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.201034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.201044 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:54:47.201096 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.201098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.201113 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.201352 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:47.201419 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.202124 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.203446 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.204092 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.204167 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.204254 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.204388 (+ 134us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.204432 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":89,"threads_started":1}
I20260929 22:54:47.204834 1545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:41963 (local address 127.0.0.1:42620)
0929 22:54:47.201039 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.201049 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.201103 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.201385 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.201386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.201388 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:47.201426 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.201427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.202667 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.202668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.203623 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.203625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.204595 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.204597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.204663 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.204668 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.204725 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.204766 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":2,"thread_start_us":52,"threads_started":1}
I20260929 22:54:47.204844 1548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42620 (local address 127.0.124.131:41963)
0929 22:54:47.201028 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.201033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.201181 (+ 148us) server_negotiation.cc:407] Connection header received
0929 22:54:47.201225 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.201227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.201241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.201313 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:47.201506 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.202555 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.203697 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.204443 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.204508 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.204559 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.204737 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.204775 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":121,"threads_started":1}
I20260929 22:54:47.205528 1333 tablet_service.cc:1467] Processing CreateTablet for tablet 56d953c47d54499a9421ded6d14d7662 (DEFAULT_TABLE table=test-table [id=8f534123b1254d25a5a1432452eaa8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:47.205708 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45863 (local address 127.0.0.1:53562)
0929 22:54:47.200759 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.200800 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.200871 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.201202 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.201205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.201207 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:47.201278 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.201279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.203693 (+ 2414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.203693 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.204480 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.204482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.205473 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.205475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.205544 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.205547 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.205594 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.205632 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":3,"thread_start_us":46,"threads_started":1}
I20260929 22:54:47.205672 1468 tablet_service.cc:1467] Processing CreateTablet for tablet 56d953c47d54499a9421ded6d14d7662 (DEFAULT_TABLE table=test-table [id=8f534123b1254d25a5a1432452eaa8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:47.205883 1333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d953c47d54499a9421ded6d14d7662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:47.205968 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.200590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53562 (local address 127.0.124.129:45863)
0929 22:54:47.200728 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.200733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.200968 (+ 235us) server_negotiation.cc:407] Connection header received
0929 22:54:47.201016 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.201019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.201036 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.201114 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:47.201358 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.202562 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.204580 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.205329 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.205394 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.205442 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.205848 (+ 406us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.205891 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
I20260929 22:54:47.206022 1468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d953c47d54499a9421ded6d14d7662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:47.206630 1197 tablet_service.cc:1467] Processing CreateTablet for tablet 56d953c47d54499a9421ded6d14d7662 (DEFAULT_TABLE table=test-table [id=8f534123b1254d25a5a1432452eaa8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:47.206916 1197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d953c47d54499a9421ded6d14d7662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:47.208981 1549 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Bootstrap starting.
I20260929 22:54:47.209563 1549 tablet_bootstrap.cc:654] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:47.209578 1550 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: Bootstrap starting.
I20260929 22:54:47.209972 1551 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: Bootstrap starting.
I20260929 22:54:47.210259 1550 tablet_bootstrap.cc:654] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:47.210420 1549 log.cc:824] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:47.210660 1551 tablet_bootstrap.cc:654] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:47.210868 1550 log.cc:824] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:47.211226 1551 log.cc:824] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:47.211268 1549 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: No bootstrap required, opened a new log
I20260929 22:54:47.211331 1549 ts_tablet_manager.cc:1397] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:47.211694 1550 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: No bootstrap required, opened a new log
I20260929 22:54:47.211764 1550 ts_tablet_manager.cc:1397] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:47.212018 1551 tablet_bootstrap.cc:492] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: No bootstrap required, opened a new log
I20260929 22:54:47.212107 1551 ts_tablet_manager.cc:1397] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:47.213416 1551 raft_consensus.cc:348] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.213583 1551 raft_consensus.cc:374] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:47.213629 1551 raft_consensus.cc:729] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab1ba9c25094c2795d58692b712700c, State: Initialized, Role: FOLLOWER
I20260929 22:54:47.213732 1551 consensus_queue.cc:260] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.213639 1549 raft_consensus.cc:348] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.213810 1549 raft_consensus.cc:374] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:47.213845 1549 raft_consensus.cc:729] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3721f1eea61b4e38ac30c27c048c442f, State: Initialized, Role: FOLLOWER
I20260929 22:54:47.213994 1551 ts_tablet_manager.cc:1428] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:47.213984 1549 consensus_queue.cc:260] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.214032 1264 heartbeater.cc:503] Master 127.0.124.190:34479 was elected leader, sending a full tablet report...
I20260929 22:54:47.214059 1550 raft_consensus.cc:348] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.214229 1550 raft_consensus.cc:374] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:47.214246 1549 ts_tablet_manager.cc:1428] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:54:47.214269 1550 raft_consensus.cc:729] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b95fb58fc744ffa87350b2624d5402, State: Initialized, Role: FOLLOWER
I20260929 22:54:47.214351 1399 heartbeater.cc:503] Master 127.0.124.190:34479 was elected leader, sending a full tablet report...
I20260929 22:54:47.214383 1550 consensus_queue.cc:260] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.214679 1550 ts_tablet_manager.cc:1428] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:54:47.214752 1535 heartbeater.cc:503] Master 127.0.124.190:34479 was elected leader, sending a full tablet report...
I20260929 22:54:47.261318 1558 raft_consensus.cc:482] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:47.261489 1558 raft_consensus.cc:504] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.261875 1558 leader_election.cc:288] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ab1ba9c25094c2795d58692b712700c (127.0.124.129:45863), 3721f1eea61b4e38ac30c27c048c442f (127.0.124.130:43375)
I20260929 22:54:47.265676 1547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.262122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:50871 (local address 127.0.124.130:43375)
0929 22:54:47.262199 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.262200 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.262332 (+ 132us) server_negotiation.cc:407] Connection header received
0929 22:54:47.262363 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.262364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.262383 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.262448 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:47.262576 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.263255 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.264744 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.265315 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.265393 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.265401 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.265569 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.265606 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 22:54:47.265676 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.262117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:49873 (local address 127.0.124.129:45863)
0929 22:54:47.262161 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.262163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.262175 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:54:47.262205 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.262206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.262237 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.262295 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:47.262463 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.263215 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.264744 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.265315 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.265393 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.265401 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.265570 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.265606 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:54:47.265714 1537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.262039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45863 (local address 127.0.124.131:49873)
0929 22:54:47.262082 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.262095 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.262150 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.262318 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.262319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.262321 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:47.262391 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.262393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.263314 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.263315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.264657 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.264659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.265404 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.265405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.265485 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.265500 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.265552 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.265594 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":60}
I20260929 22:54:47.265723 1559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.262039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:43375 (local address 127.0.124.131:50871)
0929 22:54:47.262265 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:47.262273 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:47.262319 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:47.262449 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:47.262449 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:47.262450 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:47.262516 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.262517 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.263340 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.263340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.264657 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:47.264659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.265404 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.265405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:47.265481 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.265486 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:54:47.265547 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:54:47.265594 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":118,"thread_start_us":115,"threads_started":1}
I20260929 22:54:47.266119 1218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d953c47d54499a9421ded6d14d7662" candidate_uuid: "34b95fb58fc744ffa87350b2624d5402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab1ba9c25094c2795d58692b712700c" is_pre_election: true
I20260929 22:54:47.266297 1218 raft_consensus.cc:2454] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b95fb58fc744ffa87350b2624d5402 in term 0.
I20260929 22:54:47.266299 1353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d953c47d54499a9421ded6d14d7662" candidate_uuid: "34b95fb58fc744ffa87350b2624d5402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3721f1eea61b4e38ac30c27c048c442f" is_pre_election: true
I20260929 22:54:47.266484 1353 raft_consensus.cc:2454] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b95fb58fc744ffa87350b2624d5402 in term 0.
I20260929 22:54:47.266551 1421 leader_election.cc:302] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab1ba9c25094c2795d58692b712700c, 34b95fb58fc744ffa87350b2624d5402; no voters:
I20260929 22:54:47.266687 1558 raft_consensus.cc:2781] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:47.266741 1558 raft_consensus.cc:482] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:47.266758 1558 raft_consensus.cc:3037] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:47.267490 1558 raft_consensus.cc:504] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.267628 1558 leader_election.cc:288] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [CANDIDATE]: Term 1 election: Requested vote from peers 0ab1ba9c25094c2795d58692b712700c (127.0.124.129:45863), 3721f1eea61b4e38ac30c27c048c442f (127.0.124.130:43375)
I20260929 22:54:47.267778 1353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d953c47d54499a9421ded6d14d7662" candidate_uuid: "34b95fb58fc744ffa87350b2624d5402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3721f1eea61b4e38ac30c27c048c442f"
I20260929 22:54:47.267858 1353 raft_consensus.cc:3037] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:47.268280 1218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d953c47d54499a9421ded6d14d7662" candidate_uuid: "34b95fb58fc744ffa87350b2624d5402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab1ba9c25094c2795d58692b712700c"
I20260929 22:54:47.268345 1218 raft_consensus.cc:3037] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:47.268649 1353 raft_consensus.cc:2454] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b95fb58fc744ffa87350b2624d5402 in term 1.
I20260929 22:54:47.268848 1423 leader_election.cc:302] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b95fb58fc744ffa87350b2624d5402, 3721f1eea61b4e38ac30c27c048c442f; no voters:
I20260929 22:54:47.268965 1558 raft_consensus.cc:2781] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:47.269135 1558 raft_consensus.cc:686] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [term 1 LEADER]: Becoming Leader. State: Replica: 34b95fb58fc744ffa87350b2624d5402, State: Running, Role: LEADER
I20260929 22:54:47.269223 1218 raft_consensus.cc:2454] T 56d953c47d54499a9421ded6d14d7662 P 0ab1ba9c25094c2795d58692b712700c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b95fb58fc744ffa87350b2624d5402 in term 1.
I20260929 22:54:47.269237 1558 consensus_queue.cc:237] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } }
I20260929 22:54:47.270098 1070 catalog_manager.cc:5495] T 56d953c47d54499a9421ded6d14d7662 P 34b95fb58fc744ffa87350b2624d5402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34b95fb58fc744ffa87350b2624d5402 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "34b95fb58fc744ffa87350b2624d5402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b95fb58fc744ffa87350b2624d5402" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 41963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ab1ba9c25094c2795d58692b712700c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3721f1eea61b4e38ac30c27c048c442f" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 43375 } health_report { overall_health: UNKNOWN } } }
W20260929 22:54:47.274644 1400 tablet.cc:2369] T 56d953c47d54499a9421ded6d14d7662 P 3721f1eea61b4e38ac30c27c048c442f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:47.283979 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.277322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53576 (local address 127.0.124.129:45863)
0929 22:54:47.277388 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.277391 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.277531 (+ 140us) server_negotiation.cc:407] Connection header received
0929 22:54:47.277578 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.277579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.277587 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.277634 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.278129 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.278591 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.279246 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.279416 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.279478 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.281643 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.281650 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.281651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.281657 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.283019 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.283341 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.283344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.283344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.283394 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.283559 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.283559 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.283560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.283676 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.283770 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.283831 (+ 61us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.283886 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:47.306648 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.300046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53578 (local address 127.0.124.129:45863)
0929 22:54:47.300106 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.300108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.300244 (+ 136us) server_negotiation.cc:407] Connection header received
0929 22:54:47.300370 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.300371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.300387 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.300446 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.301091 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.301570 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.302261 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.302436 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.302485 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.304541 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.304542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.304543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.304549 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.305703 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.306001 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.306001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.306002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.306048 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.306201 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.306202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.306202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.306281 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.306349 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.306470 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.306534 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:47.328303 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:47.321322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53588 (local address 127.0.124.129:45863)
0929 22:54:47.321497 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:47.321500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:47.321592 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:54:47.321673 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:47.321674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:47.321684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:47.321757 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:47.322292 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.322762 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.323499 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:47.323689 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:47.323772 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:47.325890 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:47.325892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:47.325892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:47.325899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:47.327089 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.327468 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.327469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.327470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.327524 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:47.327723 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:47.327724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:47.327724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:47.327831 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:47.327930 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:47.328088 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:54:47.328163 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
W20260929 22:54:47.328752 1177 tablet_service.cc:2908] Rejecting scan request for tablet 56d953c47d54499a9421ded6d14d7662: Uninitialized: clean time has not yet been initialized
I20260929 22:54:47.329577 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1134
I20260929 22:54:47.334514 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1269
I20260929 22:54:47.339571 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1404
I20260929 22:54:47.343782 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1039
2026-09-29T22:54:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (1924 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1574](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1574](info): set up 2 sockets
Sep 29 22:54:47 dist-test-slave-512q krb5kdc[1574](info): commencing operation
krb5kdc: starting...
W20260929 22:54:48.394146 498 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:48.507102 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38539
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:38539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:48.586823 1588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:48.587045 1588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:48.587080 1588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:48.588213 1588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:48.588318 1588 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:54:48.588340 1588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:48.588362 1588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:48.588409 1588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:48.588440 1588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:48.589902 1588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:38539
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:48.590188 1588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:48.590405 1588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:48.595261 1593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:48.595269 1594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:48.595287 1588 server_base.cc:1034] running on GCE node
W20260929 22:54:48.595261 1596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:48.595741 1588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:48.596032 1588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:48.597188 1588 hybrid_clock.cc:648] HybridClock initialized: now 1790722488597161 us; error 46 us; skew 500 ppm
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:48.599545 1588 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:48.599982 1588 webserver.cc:460] Webserver started at http://127.0.124.190:44639/ using document root <none> and password file <none>
I20260929 22:54:48.600201 1588 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:48.600318 1588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:48.600450 1588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:48.601558 1588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "b0234c3255808bd260b20ad5c794b0ac"
server_key_iv: "406d7fb28e80292155944785ef63d5f9"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.601907 1588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "b0234c3255808bd260b20ad5c794b0ac"
server_key_iv: "406d7fb28e80292155944785ef63d5f9"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.603204 1588 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:54:48.603822 1603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:48.603987 1588 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:48.604081 1588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "b0234c3255808bd260b20ad5c794b0ac"
server_key_iv: "406d7fb28e80292155944785ef63d5f9"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.604159 1588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:48.622241 1588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:48.624054 1588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:48.624279 1588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:48.628806 1588 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:38539
I20260929 22:54:48.628885 1665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:38539 every 8 connection(s)
I20260929 22:54:48.629211 1588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:48.629868 1666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:48.631476 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1588
I20260929 22:54:48.631573 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:48.631731 498 external_mini_cluster.cc:1428] Setting key 9a0966187faaa1f84a9820ffedbe9a86
I20260929 22:54:48.632336 1666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Bootstrap starting.
I20260929 22:54:48.633040 1666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:48.633369 1666 log.cc:824] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:48.634119 1666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: No bootstrap required, opened a new log
I20260929 22:54:48.636313 1666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } }
I20260929 22:54:48.636473 1666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:48.636507 1666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c7cb30f38c4c72a7f8c7828f9ab2c0, State: Initialized, Role: FOLLOWER
I20260929 22:54:48.636623 1666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } }
I20260929 22:54:48.636691 1666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:48.636726 1666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:48.636777 1666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:48.637426 1666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } }
I20260929 22:54:48.637539 1666 leader_election.cc:302] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10c7cb30f38c4c72a7f8c7828f9ab2c0; no voters:
I20260929 22:54:48.637712 1666 leader_election.cc:288] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:48.637773 1672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:48.637945 1672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [term 1 LEADER]: Becoming Leader. State: Replica: 10c7cb30f38c4c72a7f8c7828f9ab2c0, State: Running, Role: LEADER
I20260929 22:54:48.638057 1672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } }
I20260929 22:54:48.637964 1666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:48.638330 1672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10c7cb30f38c4c72a7f8c7828f9ab2c0. Latest consensus state: current_term: 1 leader_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } } }
I20260929 22:54:48.638584 1672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:48.638514 1673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c7cb30f38c4c72a7f8c7828f9ab2c0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38539 } } }
I20260929 22:54:48.638940 1673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0 [sys.catalog]: This master's current role is: LEADER
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:48.639088 1680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:48.639577 1680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:48.641152 1680 catalog_manager.cc:1347] Generated new cluster ID: b435870800f140f380ad8793e019fc79
I20260929 22:54:48.641206 1680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:54:48.643354 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:48.632253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37082 (local address 127.0.124.190:38539)
0929 22:54:48.632434 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:48.632444 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:48.632475 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:54:48.633065 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:48.633074 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:48.633145 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:48.633310 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:48.633952 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.635409 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.636112 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.636696 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.636800 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:48.639789 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:48.639792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:48.639793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:48.639804 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:48.641854 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.642221 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.642224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.642225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.642319 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.642527 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.642528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.642540 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.642760 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:48.642920 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:48.643017 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 22:54:48.643145 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260929 22:54:48.653059 1680 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:48.653565 1680 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:48.672464 1680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Generated new TSK 0
I20260929 22:54:48.672654 1680 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:48.706193 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38539
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:48.807368 1693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:48.807572 1693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:48.807629 1693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:48.808938 1693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:48.808982 1693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:48.809005 1693 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:48.809064 1693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:48.810707 1693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:38539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:48.810966 1693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:48.811201 1693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:54:48.816335 1693 server_base.cc:1034] running on GCE node
W20260929 22:54:48.816286 1701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:48.816287 1698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:48.816288 1699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:48.816797 1693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:48.817104 1693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:48.818295 1693 hybrid_clock.cc:648] HybridClock initialized: now 1790722488818273 us; error 32 us; skew 500 ppm
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:48.820889 1693 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:48.821319 1693 webserver.cc:460] Webserver started at http://127.0.124.129:33983/ using document root <none> and password file <none>
I20260929 22:54:48.821556 1693 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:48.821607 1693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:48.821738 1693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:48.822774 1693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "d77aba1fb5794af78e3772daeeff365a"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "590cf9a085b4108d479199bffafe7b3b"
server_key_iv: "2aaa646bebe35d604648f18c7ec2ba5c"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.823123 1693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "d77aba1fb5794af78e3772daeeff365a"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "590cf9a085b4108d479199bffafe7b3b"
server_key_iv: "2aaa646bebe35d604648f18c7ec2ba5c"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.824502 1693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:54:48.825192 1708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:48.825367 1693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:48.825460 1693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "d77aba1fb5794af78e3772daeeff365a"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "590cf9a085b4108d479199bffafe7b3b"
server_key_iv: "2aaa646bebe35d604648f18c7ec2ba5c"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.825532 1693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:48.861138 1693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:48.863483 1693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:48.863595 1693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:48.864063 1693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:48.864101 1693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:48.864126 1693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:48.864193 1693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:48.871031 1693 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:39605
I20260929 22:54:48.871109 1824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:39605 every 8 connection(s)
I20260929 22:54:48.871398 1693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:54:48.871773 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1693
I20260929 22:54:48.871861 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:54:48.872031 498 external_mini_cluster.cc:1428] Setting key 7326d38aaf9e3aa76dbbb395d0d45111
I20260929 22:54:48.874630 1717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:48.864576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.129:44679)
0929 22:54:48.864725 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:48.864765 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:48.865247 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:48.865540 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:48.865543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:48.865909 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:48.866221 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:48.866227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.867268 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.867269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:48.868764 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:48.868768 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.869225 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.869226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:48.869393 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:48.869940 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:48.869948 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:48.871421 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:48.873209 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:48.873215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:48.873217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:48.873512 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:48.873697 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:48.873698 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:48.873698 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:48.873835 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:48.874164 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:48.874169 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:48.874277 (+ 108us) client_negotiation.cc:769] Sending connection context
0929 22:54:48.874357 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:54:48.874476 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260929 22:54:48.874603 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:48.864579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:44679 (local address 127.0.124.190:38539)
0929 22:54:48.864650 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:48.864653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:48.864866 (+ 213us) server_negotiation.cc:407] Connection header received
0929 22:54:48.865350 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:48.865351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:48.865365 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:48.865444 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:48.866313 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.867134 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.868859 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.869134 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.869194 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:48.871538 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:48.871540 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:48.871540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:48.871554 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:48.873130 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.873585 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.873586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.873586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.873635 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.873918 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.873919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.873920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.874085 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:48.874168 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:48.874399 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 22:54:48.874488 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:54:48.875341 1825 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38539
I20260929 22:54:48.875422 1825 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:48.875599 1825 heartbeater.cc:511] Master 127.0.124.190:38539 requested a full tablet report, sending...
I20260929 22:54:48.876106 1620 ts_manager.cc:194] Registered new tserver with Master: d77aba1fb5794af78e3772daeeff365a (127.0.124.129:39605)
I20260929 22:54:48.877089 1620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:44679
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
I20260929 22:54:48.886318 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:48.876400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.129:60733)
0929 22:54:48.880354 (+ 3954us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:48.880364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:48.880436 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:48.880576 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:48.880576 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:48.880749 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:48.880794 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:48.880795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.881536 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.881537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:48.882053 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:48.882054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.882438 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.882439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:48.882507 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:48.883091 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:48.883095 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:48.883498 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:48.885378 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:48.885379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:48.885379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:48.885566 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:48.885764 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:48.885764 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:48.885764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:48.885813 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:48.886105 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:48.886105 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:48.886137 (+ 32us) client_negotiation.cc:769] Sending connection context
0929 22:54:48.886187 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:54:48.886253 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3930,"thread_start_us":70,"threads_started":1}
I20260929 22:54:48.886420 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:48.876451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:60733 (local address 127.0.124.190:38539)
0929 22:54:48.876497 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:48.876499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:48.880424 (+ 3925us) server_negotiation.cc:407] Connection header received
0929 22:54:48.880505 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:48.880506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:48.880516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:48.880571 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:48.880870 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.881430 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.882137 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:48.882352 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:48.882438 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:48.883596 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:48.883597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:48.883598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:48.883604 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:48.885296 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.885640 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.885641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.885642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.885698 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:48.885874 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:48.885874 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:48.885875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:48.886040 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:48.886112 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:48.886210 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 22:54:48.886286 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:54:48.897107 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38539
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:48.973976 1834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:48.974180 1834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:48.974200 1834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:48.975338 1834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:48.975376 1834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:48.975396 1834 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:48.975474 1834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:54:48.977087 1834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:38539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:48.977272 1834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:48.977439 1834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:48.982236 1840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:48.982263 1839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:48.982254 1834 server_base.cc:1034] running on GCE node
W20260929 22:54:48.982232 1842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:48.982640 1834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:48.982824 1834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:48.983999 1834 hybrid_clock.cc:648] HybridClock initialized: now 1790722488983979 us; error 48 us; skew 500 ppm
Sep 29 22:54:48 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:48.986342 1834 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:54:48.986744 1834 webserver.cc:460] Webserver started at http://127.0.124.130:36389/ using document root <none> and password file <none>
I20260929 22:54:48.986996 1834 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:48.987066 1834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:48.987206 1834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:48.988272 1834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "cab599b518974894a7431c8bd57015fa"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "636ccec4c7792f168118d3e12de557b5"
server_key_iv: "5f19e2423bd256a898118a236a75bdc5"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.988637 1834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "cab599b518974894a7431c8bd57015fa"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "636ccec4c7792f168118d3e12de557b5"
server_key_iv: "5f19e2423bd256a898118a236a75bdc5"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.989917 1834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:54:48.990672 1849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:48.990842 1834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:48.990948 1834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "cab599b518974894a7431c8bd57015fa"
format_stamp: "Formatted at 2026-09-29 22:54:48 on dist-test-slave-512q"
server_key: "636ccec4c7792f168118d3e12de557b5"
server_key_iv: "5f19e2423bd256a898118a236a75bdc5"
server_key_version: "encryptionkey@0"
I20260929 22:54:48.991029 1834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:49.003588 1834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:49.005381 1834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:49.005533 1834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:49.006103 1834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:49.006167 1834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.006208 1834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:49.006232 1834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:49.013480 1834 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:46313
I20260929 22:54:49.013594 1965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:46313 every 8 connection(s)
I20260929 22:54:49.013880 1834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:54:49.016203 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.006503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:53759 (local address 127.0.124.190:38539)
0929 22:54:49.006571 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.006573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.006834 (+ 261us) server_negotiation.cc:407] Connection header received
0929 22:54:49.007325 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.007327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.007339 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.007404 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.008316 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.008834 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.009861 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.010078 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.010196 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.013434 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.013436 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.013436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.013444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.014922 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.015282 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.015283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.015283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.015332 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.015534 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.015535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.015535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.015633 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.015694 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.016076 (+ 382us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.016140 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:54:49.016373 1858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.006543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.130:53759)
0929 22:54:49.006708 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.006746 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.007222 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.007473 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.007476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.007864 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:49.008190 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.008210 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.008930 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.008931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.009757 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.009759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.010204 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.010205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.010341 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.010844 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:49.010857 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:49.013333 (+ 2476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:49.015004 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.015009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.015011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.015215 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.015389 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.015389 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.015390 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.015479 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.015698 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:49.015702 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:49.015863 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.016005 (+ 142us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.016137 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260929 22:54:49.016775 1966 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38539
I20260929 22:54:49.016846 1966 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:49.017019 1966 heartbeater.cc:511] Master 127.0.124.190:38539 requested a full tablet report, sending...
I20260929 22:54:49.017385 1619 ts_manager.cc:194] Registered new tserver with Master: cab599b518974894a7431c8bd57015fa (127.0.124.130:46313)
I20260929 22:54:49.017804 1619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:53759
I20260929 22:54:49.021402 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1834
I20260929 22:54:49.021502 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:54:49.021697 498 external_mini_cluster.cc:1428] Setting key 4946e4eeed53053cab32f9cb07cf7d9f
I20260929 22:54:49.023212 1972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.017871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.130:34821)
0929 22:54:49.017978 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.017995 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.018053 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.018170 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.018170 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.018373 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:49.018454 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.018456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.019050 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.019050 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.019540 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.019541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.019836 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.019837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.019882 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.020250 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:49.020254 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:49.020524 (+ 270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:49.022188 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.022188 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.022189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.022341 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.022548 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.022549 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.022549 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.022608 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.022961 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:49.022962 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:49.023000 (+ 38us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.023058 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.023139 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":63,"threads_started":1}
I20260929 22:54:49.023326 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.017873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:34821 (local address 127.0.124.190:38539)
0929 22:54:49.017909 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.017926 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.018044 (+ 118us) server_negotiation.cc:407] Connection header received
0929 22:54:49.018109 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.018109 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.018120 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.018164 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.018532 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.018969 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.019607 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.019776 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.019823 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.020604 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.020605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.020606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.020611 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.022098 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.022420 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.022422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.022422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.022480 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.022677 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.022679 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.022679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.022878 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.022952 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.023100 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.023189 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:54:49.044777 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38539
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:49.143661 1975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:49.143865 1975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:49.143893 1975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:49.145184 1975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:49.145228 1975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:49.145274 1975 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:49.145313 1975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:54:49.146956 1975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:38539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:49.147204 1975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:49.147455 1975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:49.152712 1983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:49.152740 1981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:49.152858 1980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:49.153044 1975 server_base.cc:1034] running on GCE node
I20260929 22:54:49.153191 1975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:49.153364 1975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:49.154502 1975 hybrid_clock.cc:648] HybridClock initialized: now 1790722489154482 us; error 25 us; skew 500 ppm
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722489, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:49.157194 1975 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:54:49.157625 1975 webserver.cc:460] Webserver started at http://127.0.124.131:37413/ using document root <none> and password file <none>
I20260929 22:54:49.157792 1975 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:49.157833 1975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:49.157917 1975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:49.158891 1975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "5ad57e60ef364981a48a518a5aebdd70"
format_stamp: "Formatted at 2026-09-29 22:54:49 on dist-test-slave-512q"
server_key: "ce69f24f5b6d27e4e39a1a739c7f79d6"
server_key_iv: "004283f121fc705ed705d40ce2a99448"
server_key_version: "encryptionkey@0"
I20260929 22:54:49.159176 1975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "5ad57e60ef364981a48a518a5aebdd70"
format_stamp: "Formatted at 2026-09-29 22:54:49 on dist-test-slave-512q"
server_key: "ce69f24f5b6d27e4e39a1a739c7f79d6"
server_key_iv: "004283f121fc705ed705d40ce2a99448"
server_key_version: "encryptionkey@0"
I20260929 22:54:49.160398 1975 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:54:49.161065 1990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.161247 1975 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.161314 1975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "5ad57e60ef364981a48a518a5aebdd70"
format_stamp: "Formatted at 2026-09-29 22:54:49 on dist-test-slave-512q"
server_key: "ce69f24f5b6d27e4e39a1a739c7f79d6"
server_key_iv: "004283f121fc705ed705d40ce2a99448"
server_key_version: "encryptionkey@0"
I20260929 22:54:49.161363 1975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:49.171576 1975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:49.173435 1975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:49.173547 1975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:49.174013 1975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:49.174049 1975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.174070 1975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:49.174117 1975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722489, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:49.181280 1975 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:42177
I20260929 22:54:49.181352 2106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:42177 every 8 connection(s)
I20260929 22:54:49.181669 1975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:54:49.183838 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.174371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:57801 (local address 127.0.124.190:38539)
0929 22:54:49.174410 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.174413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.174596 (+ 183us) server_negotiation.cc:407] Connection header received
0929 22:54:49.175111 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.175113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.175126 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.175194 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.175889 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.176748 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.177813 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.178004 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.178087 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.181074 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.181075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.181076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.181084 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.182759 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.183115 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.183116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.183116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.183165 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.183361 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.183361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.183362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.183458 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.183522 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.183722 (+ 200us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.183777 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:54:49.184063 1999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.174361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.131:57801)
0929 22:54:49.174492 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.174523 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.175018 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.175255 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.175258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.175594 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:49.175817 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.175821 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.176860 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.176861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.177713 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.177715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.178095 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.178096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.178216 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.178698 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:49.178715 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:49.180936 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:49.182825 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.182830 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.182831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.183033 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.183219 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.183220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.183220 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.183308 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.183529 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:49.183532 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:49.183633 (+ 101us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.183711 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.183820 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260929 22:54:49.184476 2107 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38539
I20260929 22:54:49.184563 2107 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:49.184742 2107 heartbeater.cc:511] Master 127.0.124.190:38539 requested a full tablet report, sending...
I20260929 22:54:49.185153 1620 ts_manager.cc:194] Registered new tserver with Master: 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177)
I20260929 22:54:49.185658 1620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:57801
I20260929 22:54:49.189137 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 1975
I20260929 22:54:49.189204 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:54:49.189316 498 external_mini_cluster.cc:1428] Setting key e443d86571470dcec9b03059b65553fc
I20260929 22:54:49.190237 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:54:49.191154 2113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.185451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.124.131:43217)
0929 22:54:49.185605 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.185615 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.185673 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.185811 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.185812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.185995 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:49.186047 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.186049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.186670 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.186671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.187204 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.187205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.187610 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.187610 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.187674 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.188077 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:49.188081 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:49.188443 (+ 362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:49.190312 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.190313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.190313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.190496 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.190689 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.190689 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.190689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.190732 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.190946 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:49.190947 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:49.190977 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.191022 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.191086 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260929 22:54:49.191255 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.185531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:43217 (local address 127.0.124.190:38539)
0929 22:54:49.185567 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.185569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.185667 (+ 98us) server_negotiation.cc:407] Connection header received
0929 22:54:49.185740 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.185741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.185752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.185806 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.186119 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.186574 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.187308 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.187532 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.187599 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.188539 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.188540 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.188541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.188547 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.190215 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.190561 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.190562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.190562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.190619 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.190767 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.190767 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.190768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.190884 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.190957 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.191045 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.191119 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722489, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722489, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:49.212837 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.206246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37088 (local address 127.0.124.190:38539)
0929 22:54:49.206286 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.206287 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.206318 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:54:49.206380 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.206381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.206390 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.206440 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.206936 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.207508 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.208199 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.208423 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.208477 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.210747 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.210748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.210749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.210755 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.211908 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.212244 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.212245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.212246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.212303 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.212474 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.212474 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.212475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.212567 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.212638 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.212724 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.212775 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:54:49.214365 1620 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:49.216259 1620 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:49.223245 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35938 (local address 127.0.124.129:39605)
0929 22:54:49.218911 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.218915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.219230 (+ 315us) server_negotiation.cc:407] Connection header received
0929 22:54:49.219280 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.219283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.219299 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.219467 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:49.219621 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.220776 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.221977 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222735 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222816 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.222893 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.223084 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.223133 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260929 22:54:49.223242 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.0.124.131:42177)
0929 22:54:49.219110 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.219115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.219534 (+ 419us) server_negotiation.cc:407] Connection header received
0929 22:54:49.219580 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.219582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.219598 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.219677 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:49.219881 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.220928 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222292 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222897 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222999 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.223081 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.223108 (+ 27us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.223146 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260929 22:54:49.223227 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46313 (local address 127.0.0.1:35350)
0929 22:54:49.218900 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.218944 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.219019 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.219355 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.219358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.219361 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:49.219428 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.219430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.220655 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.220656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.222009 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.222012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222926 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.223017 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.223021 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.223071 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.223132 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":25,"thread_start_us":91,"threads_started":1}
I20260929 22:54:49.223227 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:42177 (local address 127.0.0.1:58098)
0929 22:54:49.219132 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.219141 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.219229 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.219741 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.219742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.219744 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:49.219805 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.219806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.221013 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.221014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.222198 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.222200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222997 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222997 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.223050 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.223053 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.223094 (+ 41us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.223132 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":4,"thread_start_us":54,"threads_started":1}
I20260929 22:54:49.223667 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:39605 (local address 127.0.0.1:35938)
0929 22:54:49.219129 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.219141 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.219208 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.219456 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.219457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.219459 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:49.219526 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.219528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.220868 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.220869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.221897 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.221899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222831 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.222923 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.222941 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.223495 (+ 554us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.223561 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"spinlock_wait_cycles":768,"thread_start_us":100,"threads_started":1}
I20260929 22:54:49.223784 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.218932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.0.124.130:46313)
0929 22:54:49.219192 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.219196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.219206 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:54:49.219244 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.219247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.219262 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.219342 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:49.219586 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.220569 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222110 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.222771 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.222827 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.222893 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.223605 (+ 712us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.223674 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":120,"threads_started":1}
I20260929 22:54:49.224402 1899 tablet_service.cc:1467] Processing CreateTablet for tablet 91a9af76c8b94fdab664522a526b21f4 (DEFAULT_TABLE table=test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.224434 2040 tablet_service.cc:1467] Processing CreateTablet for tablet 91a9af76c8b94fdab664522a526b21f4 (DEFAULT_TABLE table=test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.224431 1758 tablet_service.cc:1467] Processing CreateTablet for tablet 91a9af76c8b94fdab664522a526b21f4 (DEFAULT_TABLE table=test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.224745 1899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a9af76c8b94fdab664522a526b21f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.224776 1758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a9af76c8b94fdab664522a526b21f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.224776 2040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a9af76c8b94fdab664522a526b21f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.227483 2131 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Bootstrap starting.
I20260929 22:54:49.228327 2131 tablet_bootstrap.cc:654] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.228611 2132 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Bootstrap starting.
I20260929 22:54:49.228792 2131 log.cc:824] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:49.229142 2133 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Bootstrap starting.
I20260929 22:54:49.229310 2132 tablet_bootstrap.cc:654] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.229593 2132 log.cc:824] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:49.229779 2133 tablet_bootstrap.cc:654] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.230150 2133 log.cc:824] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:49.230345 2132 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: No bootstrap required, opened a new log
I20260929 22:54:49.230415 2132 ts_tablet_manager.cc:1397] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:49.230852 2133 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: No bootstrap required, opened a new log
I20260929 22:54:49.230916 2133 ts_tablet_manager.cc:1397] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:49.231029 2131 tablet_bootstrap.cc:492] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: No bootstrap required, opened a new log
I20260929 22:54:49.231410 2131 ts_tablet_manager.cc:1397] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260929 22:54:49.232391 2133 raft_consensus.cc:348] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.232527 2133 raft_consensus.cc:374] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.232551 2133 raft_consensus.cc:729] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.232512 2132 raft_consensus.cc:348] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.232676 2132 raft_consensus.cc:374] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.232672 2133 consensus_queue.cc:260] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.232715 2132 raft_consensus.cc:729] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad57e60ef364981a48a518a5aebdd70, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.232820 2132 consensus_queue.cc:260] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.232960 2133 ts_tablet_manager.cc:1428] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:54:49.232960 1825 heartbeater.cc:503] Master 127.0.124.190:38539 was elected leader, sending a full tablet report...
I20260929 22:54:49.233075 2132 ts_tablet_manager.cc:1428] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:54:49.233207 2107 heartbeater.cc:503] Master 127.0.124.190:38539 was elected leader, sending a full tablet report...
I20260929 22:54:49.233986 2131 raft_consensus.cc:348] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.234141 2131 raft_consensus.cc:374] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.234184 2131 raft_consensus.cc:729] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab599b518974894a7431c8bd57015fa, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.234310 2131 consensus_queue.cc:260] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.234583 2131 ts_tablet_manager.cc:1428] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 22:54:49.234644 1966 heartbeater.cc:503] Master 127.0.124.190:38539 was elected leader, sending a full tablet report...
I20260929 22:54:49.245046 2137 raft_consensus.cc:482] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:49.245162 2137 raft_consensus.cc:504] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.245481 2137 leader_election.cc:288] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177), cab599b518974894a7431c8bd57015fa (127.0.124.130:46313)
I20260929 22:54:49.248391 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.245720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:40169 (local address 127.0.124.130:46313)
0929 22:54:49.245758 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.245760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.245770 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:54:49.245840 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.245841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.245849 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.245949 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:49.246117 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.246615 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.247658 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.248037 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.248092 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.248099 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.248281 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.248325 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:54:49.248420 1717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.245659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46313 (local address 127.0.124.129:40169)
0929 22:54:49.245716 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.245728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.245770 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.245956 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.245957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.245959 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:49.246044 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.246046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.246694 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.246695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.247574 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.247576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.248112 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.248113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.248203 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.248226 (+ 23us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.248272 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.248316 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 22:54:49.248468 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.245720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:50305 (local address 127.0.124.131:42177)
0929 22:54:49.245772 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.245774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.245945 (+ 171us) server_negotiation.cc:407] Connection header received
0929 22:54:49.245978 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.245979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.245988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.246047 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:49.246203 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.246676 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.247719 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.248062 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.248157 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.248164 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.248359 (+ 195us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.248395 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:54:49.248549 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.245660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:42177 (local address 127.0.124.129:50305)
0929 22:54:49.245853 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.245880 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.245936 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.246054 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.246055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.246056 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:49.246134 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.246136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.246789 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.246790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.247606 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.247628 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.248169 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.248170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.248282 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.248287 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.248343 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.248380 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":20,"thread_start_us":95,"threads_started":1}
I20260929 22:54:49.248752 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a9af76c8b94fdab664522a526b21f4" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa" is_pre_election: true
I20260929 22:54:49.248790 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a9af76c8b94fdab664522a526b21f4" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70" is_pre_election: true
I20260929 22:54:49.248895 1919 raft_consensus.cc:2454] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.248921 2060 raft_consensus.cc:2454] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.249104 1709 leader_election.cc:302] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad57e60ef364981a48a518a5aebdd70, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.249248 2137 raft_consensus.cc:2781] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:49.249325 2137 raft_consensus.cc:482] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:49.249359 2137 raft_consensus.cc:3037] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.250257 2137 raft_consensus.cc:504] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.250394 2137 leader_election.cc:288] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Requested vote from peers 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177), cab599b518974894a7431c8bd57015fa (127.0.124.130:46313)
I20260929 22:54:49.250545 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a9af76c8b94fdab664522a526b21f4" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70"
I20260929 22:54:49.250556 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a9af76c8b94fdab664522a526b21f4" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa"
I20260929 22:54:49.250638 2060 raft_consensus.cc:3037] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.250635 1919 raft_consensus.cc:3037] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.251281 1919 raft_consensus.cc:2454] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.251300 2060 raft_consensus.cc:2454] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.251458 1711 leader_election.cc:302] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cab599b518974894a7431c8bd57015fa, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.251550 2137 raft_consensus.cc:2781] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:49.251678 2137 raft_consensus.cc:686] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 1 LEADER]: Becoming Leader. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Running, Role: LEADER
I20260929 22:54:49.251797 2137 consensus_queue.cc:237] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } }
I20260929 22:54:49.252606 1619 catalog_manager.cc:5495] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a reported cstate change: term changed from 0 to 1, leader changed from <none> to d77aba1fb5794af78e3772daeeff365a (127.0.124.129). New cstate: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } health_report { overall_health: HEALTHY } } }
I20260929 22:54:49.259202 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.256912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35944 (local address 127.0.124.129:39605)
0929 22:54:49.256995 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.256997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.257005 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:54:49.257080 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.257081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.257093 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.257146 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:49.257249 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.257658 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.258492 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.258670 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.258716 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.258878 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:49.258953 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:49.259016 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.259093 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.259107 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:54:49.260974 1919 raft_consensus.cc:1261] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.261009 2060 raft_consensus.cc:1261] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.261304 2137 consensus_queue.cc:1035] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.261440 2141 consensus_queue.cc:1035] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.264493 2146 mvcc.cc:205] Tried to move back new op lower bound from 7334799316009943040 to 7334799315976007680. Current Snapshot: MvccSnapshot[applied={T|T < 7334799316009943040}]
I20260929 22:54:49.264799 2145 mvcc.cc:205] Tried to move back new op lower bound from 7334799316009943040 to 7334799315976007680. Current Snapshot: MvccSnapshot[applied={T|T < 7334799316009943040 or (T in {7334799316009943040})}]
I20260929 22:54:49.267180 1618 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:49.267287 1618 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:49.267999 1618 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Sending DeleteTablet for 3 replicas of tablet 91a9af76c8b94fdab664522a526b21f4
I20260929 22:54:49.268297 2040 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a9af76c8b94fdab664522a526b21f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:58098
I20260929 22:54:49.268307 1758 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a9af76c8b94fdab664522a526b21f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:35938
I20260929 22:54:49.268541 2153 tablet_replica.cc:330] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: stopping tablet replica
I20260929 22:54:49.268501 1618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 22:54:49.268607 1899 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a9af76c8b94fdab664522a526b21f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:35350
W20260929 22:54:49.268641 1618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:49.268781 2155 tablet_replica.cc:330] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: stopping tablet replica
I20260929 22:54:49.268870 2155 raft_consensus.cc:2229] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:49.269044 2153 raft_consensus.cc:2229] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:49.269196 2153 raft_consensus.cc:2258] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.269622 2153 ts_tablet_manager.cc:1905] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.269763 2155 raft_consensus.cc:2258] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.269987 1758 tablet_service.cc:1467] Processing CreateTablet for tablet 283b049724cf4ce287aba1356e6974c5 (DEFAULT_TABLE table=test-table [id=b57b20aef2054acfb85af05b77ab3ffc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.270141 1758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283b049724cf4ce287aba1356e6974c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.270224 2040 tablet_service.cc:1467] Processing CreateTablet for tablet 283b049724cf4ce287aba1356e6974c5 (DEFAULT_TABLE table=test-table [id=b57b20aef2054acfb85af05b77ab3ffc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.270324 2040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283b049724cf4ce287aba1356e6974c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.271559 2133 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Bootstrap starting.
I20260929 22:54:49.271617 1899 tablet_service.cc:1467] Processing CreateTablet for tablet 283b049724cf4ce287aba1356e6974c5 (DEFAULT_TABLE table=test-table [id=b57b20aef2054acfb85af05b77ab3ffc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:49.271670 2132 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Bootstrap starting.
I20260929 22:54:49.271728 1899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283b049724cf4ce287aba1356e6974c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.271813 2153 ts_tablet_manager.cc:1918] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:54:49.271914 2153 log.cc:1196] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/91a9af76c8b94fdab664522a526b21f4
I20260929 22:54:49.271979 2133 tablet_bootstrap.cc:654] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.272119 2132 tablet_bootstrap.cc:654] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.272375 2153 ts_tablet_manager.cc:1939] T 91a9af76c8b94fdab664522a526b21f4 P 5ad57e60ef364981a48a518a5aebdd70: Deleting consensus metadata
I20260929 22:54:49.272820 1604 catalog_manager.cc:4841] TS 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177): tablet 91a9af76c8b94fdab664522a526b21f4 (table test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]) successfully deleted
I20260929 22:54:49.273121 2131 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Bootstrap starting.
I20260929 22:54:49.273519 2131 tablet_bootstrap.cc:654] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.273064 2155 ts_tablet_manager.cc:1905] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.274027 2131 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: No bootstrap required, opened a new log
I20260929 22:54:49.274065 2131 ts_tablet_manager.cc:1397] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 22:54:49.274165 2131 raft_consensus.cc:348] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.274209 2131 raft_consensus.cc:374] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.274222 2131 raft_consensus.cc:729] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab599b518974894a7431c8bd57015fa, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.274281 2131 consensus_queue.cc:260] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.274369 2131 ts_tablet_manager.cc:1428] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.275993 2155 ts_tablet_manager.cc:1918] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:54:49.276064 2155 log.cc:1196] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/91a9af76c8b94fdab664522a526b21f4
I20260929 22:54:49.276069 2132 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: No bootstrap required, opened a new log
I20260929 22:54:49.276131 2132 ts_tablet_manager.cc:1397] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260929 22:54:49.276295 2132 raft_consensus.cc:348] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.276328 2154 tablet_replica.cc:330] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: stopping tablet replica
I20260929 22:54:49.276366 2155 ts_tablet_manager.cc:1939] T 91a9af76c8b94fdab664522a526b21f4 P cab599b518974894a7431c8bd57015fa: Deleting consensus metadata
I20260929 22:54:49.276376 2132 raft_consensus.cc:374] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.276400 2132 raft_consensus.cc:729] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad57e60ef364981a48a518a5aebdd70, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.276499 2132 consensus_queue.cc:260] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.276546 2154 raft_consensus.cc:2229] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:54:49.276602 2132 ts_tablet_manager.cc:1428] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 22:54:49.276789 1606 catalog_manager.cc:4841] TS cab599b518974894a7431c8bd57015fa (127.0.124.130:46313): tablet 91a9af76c8b94fdab664522a526b21f4 (table test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]) successfully deleted
I20260929 22:54:49.276938 2154 raft_consensus.cc:2258] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.277387 2154 ts_tablet_manager.cc:1905] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.277397 2133 tablet_bootstrap.cc:492] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: No bootstrap required, opened a new log
I20260929 22:54:49.277484 2133 ts_tablet_manager.cc:1397] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260929 22:54:49.277621 2133 raft_consensus.cc:348] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.277693 2133 raft_consensus.cc:374] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.277712 2133 raft_consensus.cc:729] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.277758 2133 consensus_queue.cc:260] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.277842 2133 ts_tablet_manager.cc:1428] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.279011 2154 ts_tablet_manager.cc:1918] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:54:49.279066 2154 log.cc:1196] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/91a9af76c8b94fdab664522a526b21f4
I20260929 22:54:49.279248 2154 ts_tablet_manager.cc:1939] T 91a9af76c8b94fdab664522a526b21f4 P d77aba1fb5794af78e3772daeeff365a: Deleting consensus metadata
I20260929 22:54:49.279580 1605 catalog_manager.cc:4841] TS d77aba1fb5794af78e3772daeeff365a (127.0.124.129:39605): tablet 91a9af76c8b94fdab664522a526b21f4 (table test-table [id=c6c2eff19ac148eeba0746fb57cec5d2]) successfully deleted
W20260929 22:54:49.372274 1826 tablet.cc:2369] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:54:49.394179 2141 raft_consensus.cc:482] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:49.394273 2141 raft_consensus.cc:504] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.394460 2141 leader_election.cc:288] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab599b518974894a7431c8bd57015fa (127.0.124.130:46313), 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177)
I20260929 22:54:49.394719 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283b049724cf4ce287aba1356e6974c5" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70" is_pre_election: true
I20260929 22:54:49.394748 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283b049724cf4ce287aba1356e6974c5" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa" is_pre_election: true
I20260929 22:54:49.394835 2060 raft_consensus.cc:2454] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.394870 1919 raft_consensus.cc:2454] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.394984 1709 leader_election.cc:302] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad57e60ef364981a48a518a5aebdd70, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.395078 2141 raft_consensus.cc:2781] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:49.395147 2141 raft_consensus.cc:482] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:49.395176 2141 raft_consensus.cc:3037] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.395797 2141 raft_consensus.cc:504] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.395934 2141 leader_election.cc:288] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Requested vote from peers cab599b518974894a7431c8bd57015fa (127.0.124.130:46313), 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177)
I20260929 22:54:49.396092 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283b049724cf4ce287aba1356e6974c5" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa"
I20260929 22:54:49.396090 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283b049724cf4ce287aba1356e6974c5" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70"
I20260929 22:54:49.396165 1919 raft_consensus.cc:3037] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.396164 2060 raft_consensus.cc:3037] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.396895 2060 raft_consensus.cc:2454] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.396895 1919 raft_consensus.cc:2454] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.397104 1709 leader_election.cc:302] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad57e60ef364981a48a518a5aebdd70, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.397235 2141 raft_consensus.cc:2781] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:49.397326 2141 raft_consensus.cc:686] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 1 LEADER]: Becoming Leader. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Running, Role: LEADER
I20260929 22:54:49.397379 2141 consensus_queue.cc:237] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.397941 1618 catalog_manager.cc:5495] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a reported cstate change: term changed from 0 to 1, leader changed from <none> to d77aba1fb5794af78e3772daeeff365a (127.0.124.129). New cstate: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } health_report { overall_health: UNKNOWN } } }
W20260929 22:54:49.432246 2108 tablet.cc:2369] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722488, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:49.439644 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.432894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38539 (local address 127.0.0.1:37096)
0929 22:54:49.433065 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.433081 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.433162 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.433320 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.433321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.433660 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:49.433703 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.433705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.434346 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.434347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.434847 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.434848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.435185 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.435186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.435250 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.435802 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:49.435807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:49.437155 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:49.438668 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.438676 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.438679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.438861 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.439072 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:49.439073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:49.439073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:49.439167 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:49.439375 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:49.439381 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:49.439420 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.439492 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.439574 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260929 22:54:49.439723 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.432967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.0.124.190:38539)
0929 22:54:49.433042 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.433044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.433142 (+ 98us) server_negotiation.cc:407] Connection header received
0929 22:54:49.433232 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.433233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.433243 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.433316 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.433786 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.434268 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.434924 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.435105 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.435186 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.437257 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.437258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.437259 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.437265 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.438571 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.438945 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.438946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.438946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.439012 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.439223 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.439224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.439224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.439322 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.439373 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.439525 (+ 152us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.439624 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":47}
I20260929 22:54:49.441596 1618 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:37096:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:54:49.441794 1618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:49.443264 1758 tablet_service.cc:1467] Processing CreateTablet for tablet 00c11bf6ffb840cbacc29c95c34bb06b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a5e33750f5844e1b938cb433b937194a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:49.443271 2040 tablet_service.cc:1467] Processing CreateTablet for tablet 00c11bf6ffb840cbacc29c95c34bb06b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a5e33750f5844e1b938cb433b937194a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:49.443271 1899 tablet_service.cc:1467] Processing CreateTablet for tablet 00c11bf6ffb840cbacc29c95c34bb06b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a5e33750f5844e1b938cb433b937194a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:49.443420 1899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c11bf6ffb840cbacc29c95c34bb06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.443423 2040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c11bf6ffb840cbacc29c95c34bb06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.443423 1758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c11bf6ffb840cbacc29c95c34bb06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:49.444615 2133 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: Bootstrap starting.
I20260929 22:54:49.444898 2132 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: Bootstrap starting.
I20260929 22:54:49.444989 2133 tablet_bootstrap.cc:654] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.445317 2132 tablet_bootstrap.cc:654] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.445583 2133 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: No bootstrap required, opened a new log
I20260929 22:54:49.445631 2133 ts_tablet_manager.cc:1397] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:54:49.445652 2131 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: Bootstrap starting.
I20260929 22:54:49.445731 2133 raft_consensus.cc:348] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.445802 2133 raft_consensus.cc:374] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.445824 2133 raft_consensus.cc:729] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.445874 2133 consensus_queue.cc:260] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.445972 2133 ts_tablet_manager.cc:1428] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.446003 2132 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: No bootstrap required, opened a new log
I20260929 22:54:49.446041 2132 ts_tablet_manager.cc:1397] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:54:49.446039 2131 tablet_bootstrap.cc:654] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:49.445976 2141 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.446082 2141 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.446200 2132 raft_consensus.cc:348] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.446305 2132 raft_consensus.cc:374] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.446341 2132 raft_consensus.cc:729] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad57e60ef364981a48a518a5aebdd70, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.446380 2132 consensus_queue.cc:260] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.446470 2132 ts_tablet_manager.cc:1428] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.446767 2131 tablet_bootstrap.cc:492] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: No bootstrap required, opened a new log
I20260929 22:54:49.446818 2131 ts_tablet_manager.cc:1397] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 22:54:49.446762 2138 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.446851 2138 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.446957 2131 raft_consensus.cc:348] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.447027 2131 raft_consensus.cc:374] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:49.447047 2131 raft_consensus.cc:729] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab599b518974894a7431c8bd57015fa, State: Initialized, Role: FOLLOWER
I20260929 22:54:49.447085 2131 consensus_queue.cc:260] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.447181 2131 ts_tablet_manager.cc:1428] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:49.447252 2139 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.447361 2139 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 22:54:49.515021 1967 tablet.cc:2369] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:54:49.585404 2141 raft_consensus.cc:482] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:49.585502 2141 raft_consensus.cc:504] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.585651 2141 leader_election.cc:288] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab599b518974894a7431c8bd57015fa (127.0.124.130:46313), 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177)
I20260929 22:54:49.585881 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c11bf6ffb840cbacc29c95c34bb06b" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70" is_pre_election: true
I20260929 22:54:49.585881 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c11bf6ffb840cbacc29c95c34bb06b" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa" is_pre_election: true
I20260929 22:54:49.585984 1919 raft_consensus.cc:2454] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.585984 2060 raft_consensus.cc:2454] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 0.
I20260929 22:54:49.586158 1709 leader_election.cc:302] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad57e60ef364981a48a518a5aebdd70, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.586306 2141 raft_consensus.cc:2781] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:49.586374 2141 raft_consensus.cc:482] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:49.586400 2141 raft_consensus.cc:3037] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.587064 2141 raft_consensus.cc:504] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.587205 2141 leader_election.cc:288] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Requested vote from peers cab599b518974894a7431c8bd57015fa (127.0.124.130:46313), 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177)
I20260929 22:54:49.587327 1919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c11bf6ffb840cbacc29c95c34bb06b" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab599b518974894a7431c8bd57015fa"
I20260929 22:54:49.587406 1919 raft_consensus.cc:3037] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.587391 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c11bf6ffb840cbacc29c95c34bb06b" candidate_uuid: "d77aba1fb5794af78e3772daeeff365a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad57e60ef364981a48a518a5aebdd70"
I20260929 22:54:49.587463 2060 raft_consensus.cc:3037] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:49.587945 1919 raft_consensus.cc:2454] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.588093 2060 raft_consensus.cc:2454] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d77aba1fb5794af78e3772daeeff365a in term 1.
I20260929 22:54:49.588128 1711 leader_election.cc:302] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cab599b518974894a7431c8bd57015fa, d77aba1fb5794af78e3772daeeff365a; no voters:
I20260929 22:54:49.588197 2141 raft_consensus.cc:2781] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:49.588279 2141 raft_consensus.cc:686] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [term 1 LEADER]: Becoming Leader. State: Replica: d77aba1fb5794af78e3772daeeff365a, State: Running, Role: LEADER
I20260929 22:54:49.588330 2141 consensus_queue.cc:237] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } }
I20260929 22:54:49.588618 2137 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: TxnStatusTablet state changed. Reason: New leader d77aba1fb5794af78e3772daeeff365a. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.588708 2137 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:49.588843 2171 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:54:49.588976 2171 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:54:49.588909 1620 catalog_manager.cc:5495] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a reported cstate change: term changed from 0 to 1, leader changed from <none> to d77aba1fb5794af78e3772daeeff365a (127.0.124.129). New cstate: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } health_report { overall_health: UNKNOWN } } }
I20260929 22:54:49.629092 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.626323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35954 (local address 127.0.124.129:39605)
0929 22:54:49.626387 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.626389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.626401 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:54:49.626486 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.626487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.626498 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.626573 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:49.626744 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.627242 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.628394 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.628604 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.628681 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.628843 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:49.628876 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:49.628929 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.628999 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.629020 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:54:49.629124 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.626263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:39605 (local address 127.0.0.1:35954)
0929 22:54:49.626360 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.626372 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.626421 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.626606 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.626607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.626609 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:49.626665 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.626668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.627317 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.627318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.628314 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.628317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.628670 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.628671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.628739 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.628757 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:49.628941 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:49.628946 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.628998 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.629044 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260929 22:54:49.630291 2060 raft_consensus.cc:1261] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.630497 2137 consensus_queue.cc:1035] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.631083 2138 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: TxnStatusTablet state changed. Reason: New leader d77aba1fb5794af78e3772daeeff365a. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.631192 2138 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.631651 1919 raft_consensus.cc:1261] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.631884 2141 consensus_queue.cc:1035] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.632112 2141 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.632185 2141 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:49.632241 2144 mvcc.cc:205] Tried to move back new op lower bound from 7334799317524156416 to 7334799317354098688. Current Snapshot: MvccSnapshot[applied={T|T < 7334799317524156416 or (T in {7334799317524156416})}]
I20260929 22:54:49.632432 2139 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: TxnStatusTablet state changed. Reason: New leader d77aba1fb5794af78e3772daeeff365a. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.632509 2139 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.632918 2138 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.633004 2138 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P 5ad57e60ef364981a48a518a5aebdd70: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.633597 2137 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.633667 2137 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P d77aba1fb5794af78e3772daeeff365a: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:49.633913 2139 tablet_replica.cc:439] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d77aba1fb5794af78e3772daeeff365a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d77aba1fb5794af78e3772daeeff365a" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 39605 } } peers { permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 } } peers { permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 } } }
I20260929 22:54:49.634004 2139 tablet_replica.cc:442] T 00c11bf6ffb840cbacc29c95c34bb06b P cab599b518974894a7431c8bd57015fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:49.638199 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.635901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:48793 (local address 127.0.124.129:39605)
0929 22:54:49.635938 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.635939 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.636068 (+ 129us) server_negotiation.cc:407] Connection header received
0929 22:54:49.636127 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.636128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.636137 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.636189 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:49.636311 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.636744 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.637514 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.637722 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.637801 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.637943 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:49.637971 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:49.638056 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.638106 (+ 50us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.638129 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":18}
I20260929 22:54:49.638278 2178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.635838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:39605 (local address 127.0.124.129:48793)
0929 22:54:49.636004 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:49.636013 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:49.636082 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:49.636192 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:49.636192 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:49.636194 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:49.636256 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.636258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.636837 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.636838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.637394 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:49.637396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.637800 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.637801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:49.637850 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.637864 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:49.638060 (+ 196us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:49.638062 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:54:49.638106 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 22:54:49.638150 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":3,"thread_start_us":79,"threads_started":1}
I20260929 22:54:49.640434 2060 raft_consensus.cc:1261] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.640687 2179 consensus_queue.cc:1035] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad57e60ef364981a48a518a5aebdd70" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.640741 1919 raft_consensus.cc:1261] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Refusing update from remote peer d77aba1fb5794af78e3772daeeff365a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:49.641072 2179 consensus_queue.cc:1035] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab599b518974894a7431c8bd57015fa" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:49.651144 1620 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:49.651242 1620 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:49.651970 1620 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c7cb30f38c4c72a7f8c7828f9ab2c0: Sending DeleteTablet for 3 replicas of tablet 283b049724cf4ce287aba1356e6974c5
I20260929 22:54:49.652310 1758 tablet_service.cc:1514] Processing DeleteTablet for tablet 283b049724cf4ce287aba1356e6974c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:35938
I20260929 22:54:49.652408 2040 tablet_service.cc:1514] Processing DeleteTablet for tablet 283b049724cf4ce287aba1356e6974c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:58098
I20260929 22:54:49.652462 1899 tablet_service.cc:1514] Processing DeleteTablet for tablet 283b049724cf4ce287aba1356e6974c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:49 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:35350
I20260929 22:54:49.652503 2153 tablet_replica.cc:330] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: stopping tablet replica
I20260929 22:54:49.652499 2154 tablet_replica.cc:330] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: stopping tablet replica
I20260929 22:54:49.652549 2153 raft_consensus.cc:2229] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:49.652549 2154 raft_consensus.cc:2229] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:54:49.652566 2155 tablet_replica.cc:330] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: stopping tablet replica
I20260929 22:54:49.652583 2153 raft_consensus.cc:2258] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.652604 2154 raft_consensus.cc:2258] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.652619 2155 raft_consensus.cc:2229] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:49.652665 2155 raft_consensus.cc:2258] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:49.653095 2154 ts_tablet_manager.cc:1905] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.653307 2155 ts_tablet_manager.cc:1905] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.654568 2153 ts_tablet_manager.cc:1905] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:49.654873 2154 ts_tablet_manager.cc:1918] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:49.654943 2154 log.cc:1196] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/283b049724cf4ce287aba1356e6974c5
I20260929 22:54:49.655194 2154 ts_tablet_manager.cc:1939] T 283b049724cf4ce287aba1356e6974c5 P d77aba1fb5794af78e3772daeeff365a: Deleting consensus metadata
I20260929 22:54:49.655547 1605 catalog_manager.cc:4841] TS d77aba1fb5794af78e3772daeeff365a (127.0.124.129:39605): tablet 283b049724cf4ce287aba1356e6974c5 (table test-table [id=b57b20aef2054acfb85af05b77ab3ffc]) successfully deleted
I20260929 22:54:49.656286 2153 ts_tablet_manager.cc:1918] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:49.656359 2153 log.cc:1196] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/283b049724cf4ce287aba1356e6974c5
I20260929 22:54:49.656618 2153 ts_tablet_manager.cc:1939] T 283b049724cf4ce287aba1356e6974c5 P 5ad57e60ef364981a48a518a5aebdd70: Deleting consensus metadata
I20260929 22:54:49.656999 1604 catalog_manager.cc:4841] TS 5ad57e60ef364981a48a518a5aebdd70 (127.0.124.131:42177): tablet 283b049724cf4ce287aba1356e6974c5 (table test-table [id=b57b20aef2054acfb85af05b77ab3ffc]) successfully deleted
I20260929 22:54:49.657163 2155 ts_tablet_manager.cc:1918] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:49.657255 2155 log.cc:1196] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/283b049724cf4ce287aba1356e6974c5
I20260929 22:54:49.657488 2155 ts_tablet_manager.cc:1939] T 283b049724cf4ce287aba1356e6974c5 P cab599b518974894a7431c8bd57015fa: Deleting consensus metadata
I20260929 22:54:49.657835 1606 catalog_manager.cc:4841] TS cab599b518974894a7431c8bd57015fa (127.0.124.130:46313): tablet 283b049724cf4ce287aba1356e6974c5 (table test-table [id=b57b20aef2054acfb85af05b77ab3ffc]) successfully deleted
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[1574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722489, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:54:49.667335 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.654844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35970 (local address 127.0.124.129:39605)
0929 22:54:49.656908 (+ 2064us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.656910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.656919 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:54:49.656959 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.656960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.656973 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.657052 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.657765 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.658501 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.659619 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.659797 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.659859 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.663783 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.663793 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.663793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.663801 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.665821 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.666329 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.666333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.666333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.666430 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.666680 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.666681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.666682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.666845 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.667047 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.667094 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.667197 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2042}
W20260929 22:54:49.667618 1819 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35970
I20260929 22:54:49.675938 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:49.668788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37106 (local address 127.0.124.190:38539)
0929 22:54:49.668846 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:49.668849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:49.668859 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:54:49.668944 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:49.668946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:49.668958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:49.669029 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:49.669604 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.670178 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.670978 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:49.671214 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:49.671314 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:49.672843 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:49.672845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:49.672845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:49.672854 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:49.674537 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.674965 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.674966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.674967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.675041 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:49.675348 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:49.675349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:49.675349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:49.675485 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:49.675609 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:49.675737 (+ 128us) server_negotiation.cc:299] Negotiation successful
0929 22:54:49.675823 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260929 22:54:49.676192 1620 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37106
I20260929 22:54:49.677083 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1693
I20260929 22:54:49.682819 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1834
I20260929 22:54:49.687281 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1975
I20260929 22:54:49.691514 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 1588
2026-09-29T22:54:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2348 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[2189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[2189](info): set up 2 sockets
Sep 29 22:54:49 dist-test-slave-512q krb5kdc[2189](info): commencing operation
krb5kdc: starting...
W20260929 22:54:50.741993 498 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:50 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:50.858415 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:39145
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:39145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:50.936146 2202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:50.936349 2202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:50.936370 2202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:50.937474 2202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:50.937521 2202 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:54:50.937533 2202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:50.937546 2202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:50.937558 2202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:50.937569 2202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:50.938921 2202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:39145
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:39145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:50.939102 2202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:50.939256 2202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:50.943979 2207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:50.943960 2210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:50.944026 2208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:50.944155 2202 server_base.cc:1034] running on GCE node
I20260929 22:54:50.944571 2202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:50.944846 2202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:50.946007 2202 hybrid_clock.cc:648] HybridClock initialized: now 1790722490945998 us; error 35 us; skew 500 ppm
Sep 29 22:54:50 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722490, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:50.952847 2202 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:50.953265 2202 webserver.cc:460] Webserver started at http://127.0.124.190:36471/ using document root <none> and password file <none>
I20260929 22:54:50.953536 2202 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:50.953603 2202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:50.953758 2202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:50.954797 2202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "05e4bb5514894fe7974ce3db73945fb1"
format_stamp: "Formatted at 2026-09-29 22:54:50 on dist-test-slave-512q"
server_key: "abb9bf5deaf3a3593b2abc33c79be468"
server_key_iv: "1855b7f2fb5a9fd9f9d4f97c54276b36"
server_key_version: "encryptionkey@0"
I20260929 22:54:50.955147 2202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "05e4bb5514894fe7974ce3db73945fb1"
format_stamp: "Formatted at 2026-09-29 22:54:50 on dist-test-slave-512q"
server_key: "abb9bf5deaf3a3593b2abc33c79be468"
server_key_iv: "1855b7f2fb5a9fd9f9d4f97c54276b36"
server_key_version: "encryptionkey@0"
I20260929 22:54:50.956408 2202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:54:50.957089 2217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:50.957267 2202 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:54:50.957393 2202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "05e4bb5514894fe7974ce3db73945fb1"
format_stamp: "Formatted at 2026-09-29 22:54:50 on dist-test-slave-512q"
server_key: "abb9bf5deaf3a3593b2abc33c79be468"
server_key_iv: "1855b7f2fb5a9fd9f9d4f97c54276b36"
server_key_version: "encryptionkey@0"
I20260929 22:54:50.957472 2202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:50.978840 2202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:50.981325 2202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:50.981487 2202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:50.985841 2202 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:39145
I20260929 22:54:50.985954 2279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:39145 every 8 connection(s)
I20260929 22:54:50.986248 2202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:50.986891 2280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:50.989110 2280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Bootstrap starting.
I20260929 22:54:50.989677 2280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:50.989972 2280 log.cc:824] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:50.990626 2280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: No bootstrap required, opened a new log
I20260929 22:54:50.992645 2280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } }
I20260929 22:54:50.992792 2280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:50.992815 2280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e4bb5514894fe7974ce3db73945fb1, State: Initialized, Role: FOLLOWER
I20260929 22:54:50.992908 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2202
I20260929 22:54:50.993026 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:50.993009 2280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } }
I20260929 22:54:50.993104 2280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:50.993145 2280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:50.993196 2280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:50.993209 498 external_mini_cluster.cc:1428] Setting key 81939577c0d9897311009619edb1ce42
I20260929 22:54:50.993944 2280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } }
I20260929 22:54:50.994051 2280 leader_election.cc:302] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05e4bb5514894fe7974ce3db73945fb1; no voters:
I20260929 22:54:50.994195 2280 leader_election.cc:288] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:50.994243 2285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:50.994450 2285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [term 1 LEADER]: Becoming Leader. State: Replica: 05e4bb5514894fe7974ce3db73945fb1, State: Running, Role: LEADER
I20260929 22:54:50.994525 2280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:50.994590 2285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } }
I20260929 22:54:50.994905 2285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05e4bb5514894fe7974ce3db73945fb1. Latest consensus state: current_term: 1 leader_uuid: "05e4bb5514894fe7974ce3db73945fb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } } }
I20260929 22:54:50.995025 2285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:50.994918 2286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05e4bb5514894fe7974ce3db73945fb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e4bb5514894fe7974ce3db73945fb1" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 39145 } } }
I20260929 22:54:50.995227 2286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:50.996003 2292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:50.996479 2292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 22:54:50 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.000389 2292 catalog_manager.cc:1347] Generated new cluster ID: 19d1e0e38ead410e92ce4a1813ca1427
I20260929 22:54:51.000435 2292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:54:51.003705 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:50.993688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.0.124.190:39145)
0929 22:54:50.993885 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:50.993895 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:50.993929 (+ 34us) server_negotiation.cc:407] Connection header received
0929 22:54:50.994042 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:50.994049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:50.994105 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:50.994254 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:50.995071 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:50.996501 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:50.997474 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:50.998038 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:50.998169 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.000454 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.000457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.000458 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.000468 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.002127 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.002506 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.002508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.002509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.002614 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.002849 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.002850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.002851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.003062 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.003235 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.003323 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.003567 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":90,"threads_started":1}
I20260929 22:54:51.013281 2292 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:51.013866 2292 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:51.017717 2292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Generated new TSK 0
I20260929 22:54:51.017892 2292 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:51.047142 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:39145
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:51.149049 2307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:51.149269 2307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:51.149309 2307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:51.150455 2307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:51.150542 2307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:51.150581 2307 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:54:51.150629 2307 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:51.150666 2307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:51.152134 2307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:51.152400 2307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:51.152626 2307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:51.158419 2312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:51.158429 2315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:51.158687 2307 server_base.cc:1034] running on GCE node
W20260929 22:54:51.158401 2313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:51.158933 2307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:51.159171 2307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:51.160270 2307 hybrid_clock.cc:648] HybridClock initialized: now 1790722491160249 us; error 35 us; skew 500 ppm
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:51.162659 2307 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:51.163072 2307 webserver.cc:460] Webserver started at http://127.0.124.129:42527/ using document root <none> and password file <none>
I20260929 22:54:51.163305 2307 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:51.163370 2307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:51.163530 2307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:51.164614 2307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "de13bf2936b644a3916f5b1e9c9aa384"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "84658ad4265b6222f94862e5e58026b8"
server_key_iv: "1e7d841cabbd2aa1ac5cbc36d37010c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.164952 2307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "de13bf2936b644a3916f5b1e9c9aa384"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "84658ad4265b6222f94862e5e58026b8"
server_key_iv: "1e7d841cabbd2aa1ac5cbc36d37010c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.166198 2307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:54:51.166889 2322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.167057 2307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:51.167148 2307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "de13bf2936b644a3916f5b1e9c9aa384"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "84658ad4265b6222f94862e5e58026b8"
server_key_iv: "1e7d841cabbd2aa1ac5cbc36d37010c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.167220 2307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:51.187136 2307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:51.189133 2307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:51.189283 2307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:51.189749 2307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:51.189807 2307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.189874 2307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:51.189904 2307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.197012 2307 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:40893
I20260929 22:54:51.197090 2438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:40893 every 8 connection(s)
I20260929 22:54:51.197366 2307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:54:51.199779 2331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.190294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.129:45039)
0929 22:54:51.190455 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.190489 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.190971 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.191242 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.191245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.191629 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.191908 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.191915 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.192770 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.192771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.193586 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.193588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.194004 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.194005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.194159 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.194659 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.194668 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.196955 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.198631 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.198637 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.198638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.198848 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.199056 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.199057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.199057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.199145 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.199340 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.199342 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.199441 (+ 99us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.199518 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.199630 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":103,"threads_started":1}
I20260929 22:54:51.199784 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.190309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:45039 (local address 127.0.124.190:39145)
0929 22:54:51.190349 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.190351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.190575 (+ 224us) server_negotiation.cc:407] Connection header received
0929 22:54:51.191091 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.191092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.191108 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.191170 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.191996 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.192666 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.193680 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.193902 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.193989 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.197095 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.197096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.197096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.197106 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.198560 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.198941 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.198942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.198942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.198994 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.199201 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.199202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.199202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.199299 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.199349 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.199622 (+ 273us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.199715 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:54:51.200320 2439 heartbeater.cc:347] Connected to a master server at 127.0.124.190:39145
I20260929 22:54:51.200474 2439 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:51.200690 2439 heartbeater.cc:511] Master 127.0.124.190:39145 requested a full tablet report, sending...
I20260929 22:54:51.201272 2234 ts_manager.cc:194] Registered new tserver with Master: de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893)
I20260929 22:54:51.201855 2234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:45039
I20260929 22:54:51.202318 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2307
I20260929 22:54:51.202515 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:54:51.202690 498 external_mini_cluster.cc:1428] Setting key ae4fa0fe0c714808d36248cfcfaa0c92
I20260929 22:54:51.208709 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.202200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41985 (local address 127.0.124.190:39145)
0929 22:54:51.202236 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.202238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.202368 (+ 130us) server_negotiation.cc:407] Connection header received
0929 22:54:51.202397 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.202398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.202410 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.202492 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.202750 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.203521 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.204660 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.205043 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.205115 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.206026 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.206027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.206028 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.206034 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.207420 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.207869 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.207870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.207870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.207921 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.208176 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.208176 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.208177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.208350 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.208404 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.208582 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.208651 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:54:51.208813 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.202163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.129:41985)
0929 22:54:51.202288 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.202297 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.202354 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.202493 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.202493 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.202633 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.202676 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.202677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.203639 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.203640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.204569 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.204572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.205128 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.205129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.205200 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.205621 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.205625 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.205930 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.207509 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.207510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.207510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.207772 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.208011 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.208012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.208012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.208084 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.208417 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.208418 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.208470 (+ 52us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.208568 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.208680 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:54:51.227535 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:39145
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:51.308925 2448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:51.309111 2448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:51.309135 2448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:51.310194 2448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:51.310231 2448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:51.310251 2448 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:54:51.310263 2448 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:51.310280 2448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:54:51.311690 2448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:51.311862 2448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:51.312029 2448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:51.317016 2456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:51.317029 2454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:51.317195 2448 server_base.cc:1034] running on GCE node
W20260929 22:54:51.317049 2453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:51.317478 2448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:51.317732 2448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:51.318892 2448 hybrid_clock.cc:648] HybridClock initialized: now 1790722491318874 us; error 54 us; skew 500 ppm
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:51.321485 2448 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:54:51.321955 2448 webserver.cc:460] Webserver started at http://127.0.124.130:42223/ using document root <none> and password file <none>
I20260929 22:54:51.322204 2448 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:51.322271 2448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:51.322420 2448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:51.323439 2448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "235411a761264b859acfdda1a4206fb0"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "74ec30f82da79ed6d8195cbf3a1638ea"
server_key_iv: "77f5dfa9c1b9b708589f8c0a0b0896c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.323809 2448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "235411a761264b859acfdda1a4206fb0"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "74ec30f82da79ed6d8195cbf3a1638ea"
server_key_iv: "77f5dfa9c1b9b708589f8c0a0b0896c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.325146 2448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:54:51.325861 2463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.326054 2448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:51.326164 2448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "235411a761264b859acfdda1a4206fb0"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "74ec30f82da79ed6d8195cbf3a1638ea"
server_key_iv: "77f5dfa9c1b9b708589f8c0a0b0896c9"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.326244 2448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:51.341611 2448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:51.343426 2448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:51.343580 2448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:51.344107 2448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:51.344164 2448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.344254 2448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:51.344285 2448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.351244 2448 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:33325
I20260929 22:54:51.351294 2578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:33325 every 8 connection(s)
I20260929 22:54:51.351635 2448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:54:51.352056 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2448
I20260929 22:54:51.352141 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:54:51.352340 498 external_mini_cluster.cc:1428] Setting key 5ec61ad2078db4fcf2337695103c12c0
I20260929 22:54:51.354079 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.344521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:49743 (local address 127.0.124.190:39145)
0929 22:54:51.344579 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.344581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.344859 (+ 278us) server_negotiation.cc:407] Connection header received
0929 22:54:51.345367 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.345368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.345380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.345421 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.346104 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.346924 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.348493 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.348696 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.348777 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.351035 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.351037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.351037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.351045 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.352668 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.353111 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.353113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.353113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.353174 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.353391 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.353392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.353393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.353556 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.353627 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.353863 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.353940 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:54:51.354270 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.344531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.130:49743)
0929 22:54:51.344730 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.344768 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.345263 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.345524 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.345527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.345804 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.345989 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.345993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.347022 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.347023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.348397 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.348399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.348797 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.348798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.348920 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.349395 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.349403 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.350928 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.352735 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.352739 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.352741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.353029 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.353240 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.353240 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.353241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.353334 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.353631 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.353635 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.353754 (+ 119us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.353835 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.354024 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":132,"threads_started":1}
I20260929 22:54:51.354763 2579 heartbeater.cc:347] Connected to a master server at 127.0.124.190:39145
I20260929 22:54:51.354846 2579 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:51.355012 2579 heartbeater.cc:511] Master 127.0.124.190:39145 requested a full tablet report, sending...
I20260929 22:54:51.355324 2234 ts_manager.cc:194] Registered new tserver with Master: 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325)
I20260929 22:54:51.355746 2234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:49743
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:54:51.362016 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.355893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:34355 (local address 127.0.124.190:39145)
0929 22:54:51.355963 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.355964 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.356026 (+ 62us) server_negotiation.cc:407] Connection header received
0929 22:54:51.356111 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.356112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.356121 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.356148 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.356582 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.357053 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.358164 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.358346 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.358388 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.359329 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.359330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.359331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.359336 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.360933 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.361295 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.361296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.361296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.361351 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.361546 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.361547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.361547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.361693 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.361745 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.361904 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.361960 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:54:51.362020 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.355819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.130:34355)
0929 22:54:51.355964 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.355975 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.356049 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.356198 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.356199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.356426 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.356497 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.356499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.357149 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.357150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.358074 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.358077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.358413 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.358414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.358497 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.358870 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.358875 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.359247 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.361006 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.361007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.361007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.361227 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.361418 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.361420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.361420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.361487 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.361761 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.361762 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.361806 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.361873 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.361952 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:54:51.376893 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:39145
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:51.457304 2588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:51.457489 2588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:51.457521 2588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:51.458570 2588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:51.458599 2588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:51.458618 2588 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:54:51.458630 2588 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:54:51.458647 2588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:54:51.460101 2588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:51.460328 2588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:51.460500 2588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:51.465497 2594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:51.465494 2596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:51.465505 2593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:51.465792 2588 server_base.cc:1034] running on GCE node
I20260929 22:54:51.465992 2588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:51.466226 2588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:51.467379 2588 hybrid_clock.cc:648] HybridClock initialized: now 1790722491467364 us; error 30 us; skew 500 ppm
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:51.469864 2588 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:54:51.470324 2588 webserver.cc:460] Webserver started at http://127.0.124.131:33607/ using document root <none> and password file <none>
I20260929 22:54:51.470549 2588 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:51.470593 2588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:51.470731 2588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:51.471750 2588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "7f66d80b1410d2301fcd88d83bb734a7"
server_key_iv: "cff8b58964cdba1cca954ae2df067b8c"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.472093 2588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "7f66d80b1410d2301fcd88d83bb734a7"
server_key_iv: "cff8b58964cdba1cca954ae2df067b8c"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.473354 2588 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:54:51.474009 2603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.474190 2588 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:54:51.474272 2588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
format_stamp: "Formatted at 2026-09-29 22:54:51 on dist-test-slave-512q"
server_key: "7f66d80b1410d2301fcd88d83bb734a7"
server_key_iv: "cff8b58964cdba1cca954ae2df067b8c"
server_key_version: "encryptionkey@0"
I20260929 22:54:51.474339 2588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:51.489872 2588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:51.492146 2588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:51.492389 2588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:51.492852 2588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:51.492926 2588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.492969 2588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:51.492995 2588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.499905 2588 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:45109
I20260929 22:54:51.499950 2718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:45109 every 8 connection(s)
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.500322 2588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:54:51.501307 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2588
I20260929 22:54:51.501408 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:54:51.501667 498 external_mini_cluster.cc:1428] Setting key 554cf2213e3af81a35e7a2f2119d1e8d
I20260929 22:54:51.503644 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.493376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:41595 (local address 127.0.124.190:39145)
0929 22:54:51.493444 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.493446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.493686 (+ 240us) server_negotiation.cc:407] Connection header received
0929 22:54:51.494298 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.494300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.494316 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.494402 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.495201 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.496046 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.497603 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.497904 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.497980 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.500715 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.500717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.500717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.500725 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.502213 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.502682 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.502683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.502683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.502743 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.502990 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.502991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.502992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.503111 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.503188 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.503442 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.503558 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:54:51.503788 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.493352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.131:41595)
0929 22:54:51.493555 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.493592 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.494135 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.494483 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.494487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.494830 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.495109 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.495114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.496136 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.496137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.497530 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.497532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.498008 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.498009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.498166 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.498748 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.498758 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.500630 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.502282 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.502289 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.502291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.502594 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.502813 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.502814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.502815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.502925 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.503178 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.503184 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.503316 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.503420 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.503573 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":143,"threads_started":1}
I20260929 22:54:51.504289 2719 heartbeater.cc:347] Connected to a master server at 127.0.124.190:39145
I20260929 22:54:51.504366 2719 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:51.504542 2719 heartbeater.cc:511] Master 127.0.124.190:39145 requested a full tablet report, sending...
I20260929 22:54:51.504863 2234 ts_manager.cc:194] Registered new tserver with Master: c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:51.505299 2234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:41595
I20260929 22:54:51.510272 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.505279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:47299 (local address 127.0.124.190:39145)
0929 22:54:51.505313 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.505314 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.505425 (+ 111us) server_negotiation.cc:407] Connection header received
0929 22:54:51.505485 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.505485 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.505495 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.505544 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.505843 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.506298 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.507006 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.507207 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.507279 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.508025 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.508026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.508026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.508033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.509182 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.509515 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.509516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.509516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.509585 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.509788 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.509789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.509789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.509891 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.509961 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.510108 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.510188 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:54:51.510289 2725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.505214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.124.131:47299)
0929 22:54:51.505369 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.505379 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.505439 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.505547 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.505547 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.505715 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.505761 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.505762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.506414 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.506415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.506916 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.506917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.507277 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.507277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.507352 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.507679 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.507682 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.507923 (+ 241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.509273 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.509274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.509274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.509431 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.509652 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.509653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.509653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.509708 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.509955 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.509956 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.509998 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.510085 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.510190 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260929 22:54:51.513203 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.534541 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.527932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49036 (local address 127.0.124.190:39145)
0929 22:54:51.528002 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.528003 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.528011 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:54:51.528030 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.528031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.528040 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.528088 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.528685 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.529212 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.529931 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.530125 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.530177 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.532306 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.532307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.532307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.532313 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.533684 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.533985 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.533986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.533987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.534036 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.534180 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.534180 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.534180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.534264 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.534331 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.534416 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.534469 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:54:51.536092 2234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:51.537674 2234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:51.544375 2736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33325 (local address 127.0.0.1:36434)
0929 22:54:51.540159 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.540197 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.540310 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.540988 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.540992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.540994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.541060 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.541062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.542033 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.542034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.543219 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.543221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.544030 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.544031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.544120 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.544133 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.544245 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.544302 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":76,"threads_started":1}
I20260929 22:54:51.544421 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36434 (local address 127.0.124.130:33325)
0929 22:54:51.540808 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.540812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.540822 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:54:51.540859 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.540861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.540875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.541142 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.541203 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.541946 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.543306 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.543930 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.544029 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.544090 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.544285 (+ 195us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.544325 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":119,"threads_started":1}
I20260929 22:54:51.544718 2738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.0.1:52396)
0929 22:54:51.540411 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.540423 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.540481 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.541061 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.541062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.541065 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.541135 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.541137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.542430 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.542431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.543442 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.543443 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.544475 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.544476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.544543 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.544546 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.544606 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.544643 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":70,"threads_started":1}
I20260929 22:54:51.544770 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.0.124.131:45109)
0929 22:54:51.540561 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.540566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.540578 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:54:51.540623 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.540625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.540641 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.540729 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.541214 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.542331 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.543521 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.544311 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.544383 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.544437 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.544633 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.544678 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260929 22:54:51.545076 2513 tablet_service.cc:1467] Processing CreateTablet for tablet d326adeac6544f71a6ab08c3c60fc2db (DEFAULT_TABLE table=test-table [id=7da1795d5f4543fe9732e0294472f079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:51.545460 2513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d326adeac6544f71a6ab08c3c60fc2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.548097 2742 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Bootstrap starting.
I20260929 22:54:51.548643 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40893 (local address 127.0.0.1:59644)
0929 22:54:51.540665 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.540673 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.540723 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.541246 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.541247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.541249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.541286 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.541287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.542527 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.542528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.543508 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.543511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.548426 (+ 4915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.548427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.548487 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.548491 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.548540 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.548578 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260929 22:54:51.548830 2742 tablet_bootstrap.cc:654] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.548775 2653 tablet_service.cc:1467] Processing CreateTablet for tablet d326adeac6544f71a6ab08c3c60fc2db (DEFAULT_TABLE table=test-table [id=7da1795d5f4543fe9732e0294472f079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:51.548991 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.540792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59644 (local address 127.0.124.129:40893)
0929 22:54:51.540989 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.540993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.541001 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:54:51.541034 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.541036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.541052 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.541188 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.541366 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.542451 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.543596 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.544311 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.544383 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.548793 (+ 4410us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.548820 (+ 27us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.548880 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":102,"threads_started":1}
I20260929 22:54:51.549135 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d326adeac6544f71a6ab08c3c60fc2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.549177 2742 log.cc:824] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:51.549527 2373 tablet_service.cc:1467] Processing CreateTablet for tablet d326adeac6544f71a6ab08c3c60fc2db (DEFAULT_TABLE table=test-table [id=7da1795d5f4543fe9732e0294472f079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:51.549817 2373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d326adeac6544f71a6ab08c3c60fc2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.549927 2742 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: No bootstrap required, opened a new log
I20260929 22:54:51.549994 2742 ts_tablet_manager.cc:1397] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:51.551298 2742 raft_consensus.cc:348] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.551451 2742 raft_consensus.cc:374] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.551494 2742 raft_consensus.cc:729] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.551628 2742 consensus_queue.cc:260] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.551895 2742 ts_tablet_manager.cc:1428] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:51.552008 2579 heartbeater.cc:503] Master 127.0.124.190:39145 was elected leader, sending a full tablet report...
I20260929 22:54:51.552399 2745 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Bootstrap starting.
I20260929 22:54:51.553272 2746 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Bootstrap starting.
I20260929 22:54:51.553345 2745 tablet_bootstrap.cc:654] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.553637 2745 log.cc:824] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:51.553874 2746 tablet_bootstrap.cc:654] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.554222 2746 log.cc:824] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:51.554438 2745 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: No bootstrap required, opened a new log
I20260929 22:54:51.554514 2745 ts_tablet_manager.cc:1397] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:51.554895 2746 tablet_bootstrap.cc:492] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: No bootstrap required, opened a new log
I20260929 22:54:51.554946 2746 ts_tablet_manager.cc:1397] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:51.555991 2745 raft_consensus.cc:348] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.556128 2745 raft_consensus.cc:374] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.556172 2745 raft_consensus.cc:729] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.556296 2745 consensus_queue.cc:260] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.556444 2746 raft_consensus.cc:348] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.556540 2745 ts_tablet_manager.cc:1428] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:54:51.556594 2746 raft_consensus.cc:374] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.556603 2719 heartbeater.cc:503] Master 127.0.124.190:39145 was elected leader, sending a full tablet report...
I20260929 22:54:51.556641 2746 raft_consensus.cc:729] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.556743 2746 consensus_queue.cc:260] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.556985 2746 ts_tablet_manager.cc:1428] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:54:51.557026 2439 heartbeater.cc:503] Master 127.0.124.190:39145 was elected leader, sending a full tablet report...
I20260929 22:54:51.578346 2750 raft_consensus.cc:482] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:51.578475 2750 raft_consensus.cc:504] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.578855 2750 leader_election.cc:288] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:51.581545 2331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.579011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33325 (local address 127.0.124.129:53611)
0929 22:54:51.579066 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.579078 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.579150 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.579300 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.579301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.579303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.579367 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.579369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.579991 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.579992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.580751 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.580753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.581290 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.581291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.581369 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.581372 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.581442 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.581479 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:54:51.581545 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.579122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:53611 (local address 127.0.124.130:33325)
0929 22:54:51.579191 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.579193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.579202 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:54:51.579227 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.579227 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.579238 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.579285 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.579437 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.579891 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.580848 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.581205 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.581285 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.581293 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.581440 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.581478 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:54:51.581696 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.579230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:56179 (local address 127.0.124.131:45109)
0929 22:54:51.579273 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.579275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.579332 (+ 57us) server_negotiation.cc:407] Connection header received
0929 22:54:51.579392 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.579393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.579401 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.579453 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.579618 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.580064 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.580955 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.581302 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.581385 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.581391 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.581555 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.581596 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:54:51.581833 2751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.579136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.124.129:56179)
0929 22:54:51.579283 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.579292 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.579341 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.579456 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.579457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.579458 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.579549 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.579550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.580158 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.580159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.580865 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.580866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.581385 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.581386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.581463 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.581471 (+ 8us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.581539 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.581578 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260929 22:54:51.581871 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d326adeac6544f71a6ab08c3c60fc2db" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0" is_pre_election: true
I20260929 22:54:51.582029 2533 raft_consensus.cc:2454] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:51.582269 2323 leader_election.cc:302] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:51.582331 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d326adeac6544f71a6ab08c3c60fc2db" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" is_pre_election: true
I20260929 22:54:51.582412 2750 raft_consensus.cc:2781] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:51.582468 2673 raft_consensus.cc:2454] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:51.582481 2750 raft_consensus.cc:482] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:51.582520 2750 raft_consensus.cc:3037] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.583235 2750 raft_consensus.cc:504] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.583369 2750 leader_election.cc:288] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Requested vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:51.583540 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d326adeac6544f71a6ab08c3c60fc2db" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0"
I20260929 22:54:51.583559 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d326adeac6544f71a6ab08c3c60fc2db" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
I20260929 22:54:51.583630 2673 raft_consensus.cc:3037] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.583616 2533 raft_consensus.cc:3037] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.584301 2533 raft_consensus.cc:2454] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:51.584407 2673 raft_consensus.cc:2454] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:51.584589 2323 leader_election.cc:302] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:51.584694 2750 raft_consensus.cc:2781] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:51.584851 2750 raft_consensus.cc:686] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 1 LEADER]: Becoming Leader. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Running, Role: LEADER
I20260929 22:54:51.584954 2750 consensus_queue.cc:237] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } }
I20260929 22:54:51.585817 2232 catalog_manager.cc:5495] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 reported cstate change: term changed from 0 to 1, leader changed from <none> to de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "de13bf2936b644a3916f5b1e9c9aa384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } health_report { overall_health: HEALTHY } } }
W20260929 22:54:51.602826 2580 tablet.cc:2369] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:54:51 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722490, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:51.619910 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.612954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:39145 (local address 127.0.0.1:49040)
0929 22:54:51.613172 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.613190 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.613290 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.613522 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.613523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.613860 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:51.613912 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.613915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.614653 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.614654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.615251 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.615253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.615644 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.615645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.615723 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.616259 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:51.616266 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:51.617588 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:51.618960 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.618966 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.618968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.619159 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.619361 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:51.619361 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:51.619361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:51.619426 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:51.619639 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:51.619644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:51.619684 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.619752 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.619837 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":103,"threads_started":1}
I20260929 22:54:51.620015 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.613051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49040 (local address 127.0.124.190:39145)
0929 22:54:51.613144 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.613147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.613268 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:54:51.613435 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.613436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.613445 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.613518 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:51.614030 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.614564 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.615355 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.615555 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.615644 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.617671 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:51.617673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:51.617673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:51.617679 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:51.618888 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.619240 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.619241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.619241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.619303 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:51.619479 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:51.619480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:51.619480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:51.619580 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:51.619639 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.619786 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.619889 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":56}
I20260929 22:54:51.622216 2232 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:49040:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:54:51.622416 2232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:51.623823 2373 tablet_service.cc:1467] Processing CreateTablet for tablet eed5f7733e2949ae9f59c77b272446c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cf3ae6f4c64ffc885398a131b803fe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:51.623870 2653 tablet_service.cc:1467] Processing CreateTablet for tablet eed5f7733e2949ae9f59c77b272446c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cf3ae6f4c64ffc885398a131b803fe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:51.623867 2513 tablet_service.cc:1467] Processing CreateTablet for tablet eed5f7733e2949ae9f59c77b272446c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40cf3ae6f4c64ffc885398a131b803fe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:54:51.624001 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed5f7733e2949ae9f59c77b272446c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.624001 2373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed5f7733e2949ae9f59c77b272446c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.624015 2513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed5f7733e2949ae9f59c77b272446c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:51.625272 2742 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: Bootstrap starting.
I20260929 22:54:51.625705 2745 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: Bootstrap starting.
I20260929 22:54:51.625916 2746 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: Bootstrap starting.
I20260929 22:54:51.626065 2742 tablet_bootstrap.cc:654] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.626477 2745 tablet_bootstrap.cc:654] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.626484 2746 tablet_bootstrap.cc:654] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:51.627283 2746 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: No bootstrap required, opened a new log
I20260929 22:54:51.627359 2746 ts_tablet_manager.cc:1397] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:51.627568 2742 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: No bootstrap required, opened a new log
I20260929 22:54:51.627622 2742 ts_tablet_manager.cc:1397] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:51.627562 2746 raft_consensus.cc:348] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.627657 2746 raft_consensus.cc:374] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.627696 2746 raft_consensus.cc:729] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.627748 2746 consensus_queue.cc:260] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.627766 2742 raft_consensus.cc:348] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.627840 2742 raft_consensus.cc:374] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.627863 2742 raft_consensus.cc:729] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.627874 2746 ts_tablet_manager.cc:1428] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.627904 2742 consensus_queue.cc:260] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.627996 2742 ts_tablet_manager.cc:1428] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:51.627974 2750 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.628536 2750 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.628722 2745 tablet_bootstrap.cc:492] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: No bootstrap required, opened a new log
I20260929 22:54:51.628793 2745 ts_tablet_manager.cc:1397] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260929 22:54:51.628958 2745 raft_consensus.cc:348] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.629051 2745 raft_consensus.cc:374] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:51.629091 2745 raft_consensus.cc:729] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Initialized, Role: FOLLOWER
I20260929 22:54:51.629148 2745 consensus_queue.cc:260] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.629281 2745 ts_tablet_manager.cc:1428] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:51.629455 2749 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.629242 2744 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.629566 2749 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.629582 2744 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 22:54:51.698153 2440 tablet.cc:2369] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:54:51.750993 2720 tablet.cc:2369] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:54:51.956284 2749 raft_consensus.cc:482] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:51.956375 2749 raft_consensus.cc:504] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.956738 2749 leader_election.cc:288] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893), 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325)
I20260929 22:54:51.960644 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.957125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:39205 (local address 127.0.124.129:40893)
0929 22:54:51.957188 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.957189 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.957205 (+ 16us) server_negotiation.cc:407] Connection header received
0929 22:54:51.957292 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.957293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.957308 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.957367 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.957523 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.958298 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.959704 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.960287 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.960365 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.960373 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.960537 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.960573 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:54:51.960669 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.957022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40893 (local address 127.0.124.131:39205)
0929 22:54:51.957130 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.957140 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.957223 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.957383 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.957384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.957385 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.957453 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.957454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.958370 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.958371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.959609 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.959611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.960371 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.960372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.960463 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.960465 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.960522 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.960562 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":44}
I20260929 22:54:51.960644 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.957384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:52329 (local address 127.0.124.130:33325)
0929 22:54:51.957447 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.957449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.957602 (+ 153us) server_negotiation.cc:407] Connection header received
0929 22:54:51.957630 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.957631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.957640 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.957705 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:51.957822 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.958482 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.959739 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.960301 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.960365 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.960373 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.960536 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.960575 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:54:51.960675 2763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.957324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33325 (local address 127.0.124.131:52329)
0929 22:54:51.957525 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.957534 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.957584 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.957710 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.957710 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.957712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:51.957758 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.957759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.958547 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.958547 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.959655 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.959657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.960389 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.960389 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.960459 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.960463 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.960532 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.960562 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":135,"threads_started":1}
I20260929 22:54:51.961010 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed5f7733e2949ae9f59c77b272446c1" candidate_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0" is_pre_election: true
I20260929 22:54:51.961026 2393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed5f7733e2949ae9f59c77b272446c1" candidate_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de13bf2936b644a3916f5b1e9c9aa384" is_pre_election: true
I20260929 22:54:51.961109 2533 raft_consensus.cc:2454] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c5932bd1b344028e2a4e3ffb234bc1 in term 0.
I20260929 22:54:51.961129 2393 raft_consensus.cc:2454] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c5932bd1b344028e2a4e3ffb234bc1 in term 0.
I20260929 22:54:51.961324 2604 leader_election.cc:302] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6c5932bd1b344028e2a4e3ffb234bc1, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:51.961463 2749 raft_consensus.cc:2781] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:51.961503 2749 raft_consensus.cc:482] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:51.961534 2749 raft_consensus.cc:3037] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.962174 2749 raft_consensus.cc:504] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.962301 2749 leader_election.cc:288] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [CANDIDATE]: Term 1 election: Requested vote from peers de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893), 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325)
I20260929 22:54:51.962482 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed5f7733e2949ae9f59c77b272446c1" candidate_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0"
I20260929 22:54:51.962549 2533 raft_consensus.cc:3037] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.963058 2533 raft_consensus.cc:2454] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c5932bd1b344028e2a4e3ffb234bc1 in term 1.
I20260929 22:54:51.963147 2393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed5f7733e2949ae9f59c77b272446c1" candidate_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de13bf2936b644a3916f5b1e9c9aa384"
I20260929 22:54:51.963205 2604 leader_election.cc:302] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, c6c5932bd1b344028e2a4e3ffb234bc1; no voters:
I20260929 22:54:51.963265 2393 raft_consensus.cc:3037] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:51.963310 2749 raft_consensus.cc:2781] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:51.963503 2749 raft_consensus.cc:686] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 LEADER]: Becoming Leader. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Running, Role: LEADER
I20260929 22:54:51.963619 2749 consensus_queue.cc:237] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:51.963965 2393 raft_consensus.cc:2454] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c5932bd1b344028e2a4e3ffb234bc1 in term 1.
I20260929 22:54:51.964064 2764 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: TxnStatusTablet state changed. Reason: New leader c6c5932bd1b344028e2a4e3ffb234bc1. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.964151 2764 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:51.964442 2766 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:54:51.964577 2766 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:54:51.964498 2233 catalog_manager.cc:5495] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } health_report { overall_health: HEALTHY } } }
I20260929 22:54:51.983237 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.980245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.0.1:52404)
0929 22:54:51.980431 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.980471 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.980530 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.980702 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.980702 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.980703 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:51.980744 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.980746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.981636 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.981637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.982203 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.982205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.982655 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.982655 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.982752 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.982774 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:51.983049 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:51.983058 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.983124 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.983168 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260929 22:54:51.983446 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.980342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.0.124.131:45109)
0929 22:54:51.980383 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.980385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.980525 (+ 140us) server_negotiation.cc:407] Connection header received
0929 22:54:51.980601 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.980603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.980620 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.980693 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:51.980787 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.981540 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.982280 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.982580 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.982651 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.982882 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:51.982975 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:51.983087 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.983128 (+ 41us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.983148 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:54:51.985138 2533 raft_consensus.cc:1261] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Refusing update from remote peer c6c5932bd1b344028e2a4e3ffb234bc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:51.985152 2393 raft_consensus.cc:1261] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Refusing update from remote peer c6c5932bd1b344028e2a4e3ffb234bc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:51.985431 2764 consensus_queue.cc:1035] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:51.985567 2749 consensus_queue.cc:1035] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:51.986574 2750 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: TxnStatusTablet state changed. Reason: New leader c6c5932bd1b344028e2a4e3ffb234bc1. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.986658 2750 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.986673 2744 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: TxnStatusTablet state changed. Reason: New leader c6c5932bd1b344028e2a4e3ffb234bc1. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.986752 2744 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.987986 2769 mvcc.cc:205] Tried to move back new op lower bound from 7334799327168684032 to 7334799327083388928. Current Snapshot: MvccSnapshot[applied={T|T < 7334799327168684032}]
I20260929 22:54:51.988399 2764 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.988556 2764 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:51.988540 2744 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.988631 2744 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P 235411a761264b859acfdda1a4206fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.988703 2764 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.988791 2764 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P c6c5932bd1b344028e2a4e3ffb234bc1: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:54:51.989320 2750 tablet_replica.cc:439] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } } }
I20260929 22:54:51.989408 2750 tablet_replica.cc:442] T eed5f7733e2949ae9f59c77b272446c1 P de13bf2936b644a3916f5b1e9c9aa384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:54:51.989753 2771 mvcc.cc:205] Tried to move back new op lower bound from 7334799327168684032 to 7334799327083388928. Current Snapshot: MvccSnapshot[applied={T|T < 7334799327168684032 or (T in {7334799327168684032})}]
I20260929 22:54:51.993947 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.991539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59656 (local address 127.0.124.129:40893)
0929 22:54:51.991585 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.991587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.991594 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:54:51.991646 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.991646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.991659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.991740 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:51.991891 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.992425 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.993184 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.993387 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.993461 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.993637 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:51.993737 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:51.993823 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.993860 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.993877 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:54:51.998806 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.996319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:33695 (local address 127.0.124.131:45109)
0929 22:54:51.996353 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:51.996355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:51.996482 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:54:51.996534 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:51.996535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:51.996542 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:51.996583 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:51.996702 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.997155 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.998227 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.998393 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.998441 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.998636 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:51.998657 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:51.998691 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:51.998746 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 22:54:51.998760 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:54:51.998875 2781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:51.996274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.124.129:33695)
0929 22:54:51.996418 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:51.996428 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:51.996480 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:51.996594 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:51.996595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:51.996596 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:51.996650 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.996651 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.997229 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.997230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.998150 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:51.998152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:51.998461 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:51.998462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:51.998529 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:51.998542 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:51.998694 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:51.998696 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:54:51.998745 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:54:51.998790 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260929 22:54:52.001350 2533 raft_consensus.cc:1261] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:52.001405 2673 raft_consensus.cc:1261] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:52.001585 2752 consensus_queue.cc:1035] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:52.001711 2750 consensus_queue.cc:1035] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:52.010564 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.007489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:42835 (local address 127.0.124.129:40893)
0929 22:54:52.007526 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.007527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.007632 (+ 105us) server_negotiation.cc:407] Connection header received
0929 22:54:52.007694 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.007694 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.007722 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.007775 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:52.008314 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.008861 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.009915 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.010087 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.010151 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.010337 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.010361 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.010399 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.010498 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.010513 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:54:52.010614 2725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.007440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40893 (local address 127.0.124.131:42835)
0929 22:54:52.007549 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:52.007576 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:52.007647 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:52.007778 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:52.007779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:52.007780 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:52.008181 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.008183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.008936 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.008937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.009836 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.009838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.010184 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.010185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.010252 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.010266 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.010443 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.010445 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:54:52.010496 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:54:52.010539 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260929 22:54:52.022732 2233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:52.022863 2233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:52.023617 2233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Sending DeleteTablet for 3 replicas of tablet d326adeac6544f71a6ab08c3c60fc2db
I20260929 22:54:52.023945 2373 tablet_service.cc:1514] Processing DeleteTablet for tablet d326adeac6544f71a6ab08c3c60fc2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:52 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:59644
I20260929 22:54:52.023945 2513 tablet_service.cc:1514] Processing DeleteTablet for tablet d326adeac6544f71a6ab08c3c60fc2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:52 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:36434
I20260929 22:54:52.023943 2653 tablet_service.cc:1514] Processing DeleteTablet for tablet d326adeac6544f71a6ab08c3c60fc2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:52 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:52396
I20260929 22:54:52.024343 2790 tablet_replica.cc:330] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: stopping tablet replica
I20260929 22:54:52.024488 2790 raft_consensus.cc:2229] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:54:52.024415 2233 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:52.024564 2233 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:52.025024 2790 raft_consensus.cc:2258] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:52.025254 2791 tablet_replica.cc:330] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: stopping tablet replica
I20260929 22:54:52.025478 2791 raft_consensus.cc:2229] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:52.025812 2790 ts_tablet_manager.cc:1905] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:52.026031 2373 tablet_service.cc:1467] Processing CreateTablet for tablet 592f811e0a054652b1e4017ee615658f (DEFAULT_TABLE table=test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:52.026126 2373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592f811e0a054652b1e4017ee615658f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:52.027442 2746 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Bootstrap starting.
I20260929 22:54:52.027777 2790 ts_tablet_manager.cc:1918] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:52.027837 2790 log.cc:1196] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/d326adeac6544f71a6ab08c3c60fc2db
I20260929 22:54:52.027851 2746 tablet_bootstrap.cc:654] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:52.028100 2790 ts_tablet_manager.cc:1939] T d326adeac6544f71a6ab08c3c60fc2db P de13bf2936b644a3916f5b1e9c9aa384: Deleting consensus metadata
I20260929 22:54:52.028537 2218 catalog_manager.cc:4841] TS de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893): tablet d326adeac6544f71a6ab08c3c60fc2db (table test-table [id=7da1795d5f4543fe9732e0294472f079]) successfully deleted
I20260929 22:54:52.028535 2653 tablet_service.cc:1467] Processing CreateTablet for tablet 592f811e0a054652b1e4017ee615658f (DEFAULT_TABLE table=test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:52.028667 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592f811e0a054652b1e4017ee615658f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:52.028714 2513 tablet_service.cc:1467] Processing CreateTablet for tablet 592f811e0a054652b1e4017ee615658f (DEFAULT_TABLE table=test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:52.029063 2513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 592f811e0a054652b1e4017ee615658f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:52.029917 2745 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Bootstrap starting.
I20260929 22:54:52.030078 2742 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Bootstrap starting.
I20260929 22:54:52.030268 2745 tablet_bootstrap.cc:654] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:52.030335 2791 raft_consensus.cc:2258] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:52.030498 2742 tablet_bootstrap.cc:654] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:52.030788 2791 ts_tablet_manager.cc:1905] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:52.032110 2791 ts_tablet_manager.cc:1918] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:52.032182 2791 log.cc:1196] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/d326adeac6544f71a6ab08c3c60fc2db
I20260929 22:54:52.032434 2791 ts_tablet_manager.cc:1939] T d326adeac6544f71a6ab08c3c60fc2db P 235411a761264b859acfdda1a4206fb0: Deleting consensus metadata
I20260929 22:54:52.032826 2218 catalog_manager.cc:4841] TS 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325): tablet d326adeac6544f71a6ab08c3c60fc2db (table test-table [id=7da1795d5f4543fe9732e0294472f079]) successfully deleted
I20260929 22:54:52.032935 2746 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: No bootstrap required, opened a new log
I20260929 22:54:52.032991 2746 ts_tablet_manager.cc:1397] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260929 22:54:52.033134 2746 raft_consensus.cc:348] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.033212 2746 raft_consensus.cc:374] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:52.033239 2746 raft_consensus.cc:729] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Initialized, Role: FOLLOWER
I20260929 22:54:52.033277 2746 consensus_queue.cc:260] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.033368 2746 ts_tablet_manager.cc:1428] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:52.033852 2742 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: No bootstrap required, opened a new log
I20260929 22:54:52.033902 2742 ts_tablet_manager.cc:1397] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 22:54:52.034055 2742 raft_consensus.cc:348] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.034130 2742 raft_consensus.cc:374] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:52.034158 2742 raft_consensus.cc:729] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Initialized, Role: FOLLOWER
I20260929 22:54:52.034196 2742 consensus_queue.cc:260] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.034281 2742 ts_tablet_manager.cc:1428] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:52.036589 2745 tablet_bootstrap.cc:492] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: No bootstrap required, opened a new log
I20260929 22:54:52.036646 2745 ts_tablet_manager.cc:1397] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20260929 22:54:52.036774 2745 raft_consensus.cc:348] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.036842 2745 raft_consensus.cc:374] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:52.036861 2745 raft_consensus.cc:729] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Initialized, Role: FOLLOWER
I20260929 22:54:52.036911 2745 consensus_queue.cc:260] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.037010 2745 ts_tablet_manager.cc:1428] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:52.037108 2789 tablet_replica.cc:330] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: stopping tablet replica
I20260929 22:54:52.037184 2789 raft_consensus.cc:2229] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:52.037221 2789 raft_consensus.cc:2258] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:52.037616 2789 ts_tablet_manager.cc:1905] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:52.039139 2789 ts_tablet_manager.cc:1918] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:52.039223 2789 log.cc:1196] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/d326adeac6544f71a6ab08c3c60fc2db
I20260929 22:54:52.039454 2789 ts_tablet_manager.cc:1939] T d326adeac6544f71a6ab08c3c60fc2db P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting consensus metadata
I20260929 22:54:52.039872 2218 catalog_manager.cc:4841] TS c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109): tablet d326adeac6544f71a6ab08c3c60fc2db (table test-table [id=7da1795d5f4543fe9732e0294472f079]) successfully deleted
I20260929 22:54:52.135950 2744 raft_consensus.cc:482] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:52.136065 2744 raft_consensus.cc:504] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.136409 2744 leader_election.cc:288] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:52.140430 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.136929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:33137 (local address 127.0.124.131:45109)
0929 22:54:52.136966 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.136968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.137132 (+ 164us) server_negotiation.cc:407] Connection header received
0929 22:54:52.137231 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.137232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.137244 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.137271 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:52.137438 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.138083 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.139478 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.140022 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.140060 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.140068 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.140337 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.140368 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:54:52.140430 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.136649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55151 (local address 127.0.124.129:40893)
0929 22:54:52.136694 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.136696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.136817 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:54:52.136955 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.136957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.136968 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.136998 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:54:52.137227 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.137965 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.139478 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.140014 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.140060 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.140068 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.140327 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.140362 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:54:52.140643 2795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.136605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40893 (local address 127.0.124.130:55151)
0929 22:54:52.136742 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:52.136753 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:52.136862 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:52.137065 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:52.137066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:52.137068 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:52.137144 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.137146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.138058 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.138059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.139377 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.139380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.140129 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.140130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.140239 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.140243 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:54:52.140548 (+ 305us) client_negotiation.cc:240] Negotiation successful
0929 22:54:52.140575 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":88,"thread_start_us":58,"threads_started":1}
I20260929 22:54:52.140643 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.136786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.124.130:33137)
0929 22:54:52.137080 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:52.137090 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:52.137152 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:52.137323 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:52.137323 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:52.137325 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:54:52.137373 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.137374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.138163 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.138164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.139377 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.139380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.140130 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.140131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.140259 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.140261 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:54:52.140504 (+ 243us) client_negotiation.cc:240] Negotiation successful
0929 22:54:52.140553 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":64,"thread_start_us":31,"threads_started":1}
I20260929 22:54:52.140949 2393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592f811e0a054652b1e4017ee615658f" candidate_uuid: "235411a761264b859acfdda1a4206fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de13bf2936b644a3916f5b1e9c9aa384" is_pre_election: true
I20260929 22:54:52.141000 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592f811e0a054652b1e4017ee615658f" candidate_uuid: "235411a761264b859acfdda1a4206fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" is_pre_election: true
I20260929 22:54:52.141055 2393 raft_consensus.cc:2454] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 235411a761264b859acfdda1a4206fb0 in term 0.
I20260929 22:54:52.141067 2673 raft_consensus.cc:2454] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 235411a761264b859acfdda1a4206fb0 in term 0.
I20260929 22:54:52.141232 2464 leader_election.cc:302] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:52.141345 2744 raft_consensus.cc:2781] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:52.141382 2744 raft_consensus.cc:482] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:52.141405 2744 raft_consensus.cc:3037] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:52.142180 2744 raft_consensus.cc:504] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.142308 2744 leader_election.cc:288] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [CANDIDATE]: Term 1 election: Requested vote from peers de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:52.142467 2393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592f811e0a054652b1e4017ee615658f" candidate_uuid: "235411a761264b859acfdda1a4206fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de13bf2936b644a3916f5b1e9c9aa384"
I20260929 22:54:52.142568 2393 raft_consensus.cc:3037] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:52.142470 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "592f811e0a054652b1e4017ee615658f" candidate_uuid: "235411a761264b859acfdda1a4206fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
I20260929 22:54:52.142607 2673 raft_consensus.cc:3037] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:52.143220 2393 raft_consensus.cc:2454] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 235411a761264b859acfdda1a4206fb0 in term 1.
I20260929 22:54:52.143363 2464 leader_election.cc:302] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:52.143416 2673 raft_consensus.cc:2454] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 235411a761264b859acfdda1a4206fb0 in term 1.
I20260929 22:54:52.143433 2744 raft_consensus.cc:2781] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:52.143568 2744 raft_consensus.cc:686] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Running, Role: LEADER
I20260929 22:54:52.143626 2744 consensus_queue.cc:237] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:52.144397 2233 catalog_manager.cc:5495] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 235411a761264b859acfdda1a4206fb0 (127.0.124.130). New cstate: current_term: 1 leader_uuid: "235411a761264b859acfdda1a4206fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } health_report { overall_health: UNKNOWN } } }
I20260929 22:54:52.178933 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.176043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36446 (local address 127.0.124.130:33325)
0929 22:54:52.176096 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.176098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.176142 (+ 44us) server_negotiation.cc:407] Connection header received
0929 22:54:52.176222 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.176222 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.176258 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.176329 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:52.176500 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.176987 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.178099 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.178398 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.178454 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.178603 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.178738 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.178811 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.178834 (+ 23us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.178853 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:54:52.183797 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.181525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55395 (local address 127.0.124.131:45109)
0929 22:54:52.181570 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.181572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.181690 (+ 118us) server_negotiation.cc:407] Connection header received
0929 22:54:52.181709 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.181710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.181718 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.181754 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:52.181872 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.182308 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.183174 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.183336 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.183416 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.183603 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.183626 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.183664 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.183718 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.183732 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:54:52.184012 2801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.181423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45109 (local address 127.0.124.130:55395)
0929 22:54:52.181588 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:52.181599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:52.181659 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:52.181759 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:52.181759 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:52.181760 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:52.181819 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.181821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.182401 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.182402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.183106 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.183108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.183484 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.183485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.183527 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.183538 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.183682 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.183683 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:54:52.183718 (+ 35us) client_negotiation.cc:240] Negotiation successful
0929 22:54:52.183748 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260929 22:54:52.186137 2393 raft_consensus.cc:1261] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Refusing update from remote peer 235411a761264b859acfdda1a4206fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:52.186147 2673 raft_consensus.cc:1261] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Refusing update from remote peer 235411a761264b859acfdda1a4206fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:52.186383 2797 consensus_queue.cc:1035] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:52.186548 2744 consensus_queue.cc:1035] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:52.193236 2725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.190901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33325 (local address 127.0.124.131:40277)
0929 22:54:52.190943 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:52.190952 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:52.190995 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:52.191145 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:52.191146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:52.191147 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:54:52.191187 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.191188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.191880 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.191880 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.192464 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:52.192465 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.192868 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.192869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:52.192925 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.192929 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.193093 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.193094 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:54:52.193139 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:54:52.193177 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260929 22:54:52.193233 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:52.190938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:40277 (local address 127.0.124.130:33325)
0929 22:54:52.190976 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:52.190979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:52.190987 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:54:52.191056 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:52.191057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:52.191065 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:52.191142 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:52.191237 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.191815 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.192541 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:52.192795 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:52.192864 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:52.193000 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:52.193030 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:52.193084 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:52.193143 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 22:54:52.193164 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:54:52.193506 2771 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 22:54:53.713083 2232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:53.713188 2232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:53.713984 2232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Sending DeleteTablet for 3 replicas of tablet 592f811e0a054652b1e4017ee615658f
I20260929 22:54:53.714224 2373 tablet_service.cc:1514] Processing DeleteTablet for tablet 592f811e0a054652b1e4017ee615658f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:59644
I20260929 22:54:53.714234 2513 tablet_service.cc:1514] Processing DeleteTablet for tablet 592f811e0a054652b1e4017ee615658f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:36434
I20260929 22:54:53.714440 2653 tablet_service.cc:1514] Processing DeleteTablet for tablet 592f811e0a054652b1e4017ee615658f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:52396
I20260929 22:54:53.716442 2828 tablet_replica.cc:330] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: stopping tablet replica
I20260929 22:54:53.716537 2828 raft_consensus.cc:2229] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:53.716595 2828 raft_consensus.cc:2258] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.716648 2829 tablet_replica.cc:330] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: stopping tablet replica
I20260929 22:54:53.716724 2829 raft_consensus.cc:2229] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:54:53.716816 2829 raft_consensus.cc:2258] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.716926 2830 tablet_replica.cc:330] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: stopping tablet replica
I20260929 22:54:53.717015 2830 raft_consensus.cc:2229] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:53.717065 2830 raft_consensus.cc:2258] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.717080 2829 ts_tablet_manager.cc:1905] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.717088 2828 ts_tablet_manager.cc:1905] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.717286 2830 ts_tablet_manager.cc:1905] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.718825 2829 ts_tablet_manager.cc:1918] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:54:53.718858 2828 ts_tablet_manager.cc:1918] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:54:53.718886 2829 log.cc:1196] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/592f811e0a054652b1e4017ee615658f
I20260929 22:54:53.718883 2830 ts_tablet_manager.cc:1918] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:54:53.718914 2828 log.cc:1196] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/592f811e0a054652b1e4017ee615658f
I20260929 22:54:53.718928 2830 log.cc:1196] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/592f811e0a054652b1e4017ee615658f
I20260929 22:54:53.719141 2829 ts_tablet_manager.cc:1939] T 592f811e0a054652b1e4017ee615658f P 235411a761264b859acfdda1a4206fb0: Deleting consensus metadata
I20260929 22:54:53.719154 2830 ts_tablet_manager.cc:1939] T 592f811e0a054652b1e4017ee615658f P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting consensus metadata
I20260929 22:54:53.719182 2828 ts_tablet_manager.cc:1939] T 592f811e0a054652b1e4017ee615658f P de13bf2936b644a3916f5b1e9c9aa384: Deleting consensus metadata
I20260929 22:54:53.719444 2218 catalog_manager.cc:4841] TS 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325): tablet 592f811e0a054652b1e4017ee615658f (table test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]) successfully deleted
I20260929 22:54:53.719532 2218 catalog_manager.cc:4841] TS c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109): tablet 592f811e0a054652b1e4017ee615658f (table test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]) successfully deleted
I20260929 22:54:53.719760 2218 catalog_manager.cc:4841] TS de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893): tablet 592f811e0a054652b1e4017ee615658f (table test-table [id=c7aa26e96af04bf39adf0655e43d7bdc]) successfully deleted
Sep 29 22:54:53 dist-test-slave-512q krb5kdc[2189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722493, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:54:53 dist-test-slave-512q krb5kdc[2189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722493, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:53.738611 2838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:53.731336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.0.124.190:39145)
0929 22:54:53.731482 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:53.731483 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:53.731501 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:54:53.731632 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:53.731633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:53.731645 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:53.731726 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:53.732329 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:53.732907 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:53.733626 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:53.733823 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:53.733893 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:53.736138 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:53.736140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:53.736140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:53.736146 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:53.737568 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:53.737998 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:53.737999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:53.737999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:53.738055 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:53.738228 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:53.738228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:53.738228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:53.738326 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:53.738401 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:53.738476 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 22:54:53.738549 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":92,"threads_started":1}
I20260929 22:54:53.739970 2232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:53.740130 2232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:53.741498 2373 tablet_service.cc:1467] Processing CreateTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c (DEFAULT_TABLE table=test-table [id=6856838721d24283ac9b960b7d2eed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.741520 2513 tablet_service.cc:1467] Processing CreateTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c (DEFAULT_TABLE table=test-table [id=6856838721d24283ac9b960b7d2eed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.741559 2653 tablet_service.cc:1467] Processing CreateTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c (DEFAULT_TABLE table=test-table [id=6856838721d24283ac9b960b7d2eed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.741631 2373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d9cd51ad9e4f53b81e72e5530b676c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.741637 2513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d9cd51ad9e4f53b81e72e5530b676c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.741660 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0d9cd51ad9e4f53b81e72e5530b676c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.742720 2839 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Bootstrap starting.
I20260929 22:54:53.743086 2841 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Bootstrap starting.
I20260929 22:54:53.743244 2839 tablet_bootstrap.cc:654] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.743453 2841 tablet_bootstrap.cc:654] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.743777 2840 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Bootstrap starting.
I20260929 22:54:53.743851 2839 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: No bootstrap required, opened a new log
I20260929 22:54:53.743937 2839 ts_tablet_manager.cc:1397] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:53.744004 2841 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: No bootstrap required, opened a new log
I20260929 22:54:53.744056 2841 ts_tablet_manager.cc:1397] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:53.744053 2839 raft_consensus.cc:348] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.744125 2840 tablet_bootstrap.cc:654] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.744140 2839 raft_consensus.cc:374] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.744166 2839 raft_consensus.cc:729] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.744166 2841 raft_consensus.cc:348] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.744258 2841 raft_consensus.cc:374] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.744263 2839 consensus_queue.cc:260] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.744316 2841 raft_consensus.cc:729] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.744387 2841 consensus_queue.cc:260] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.744445 2839 ts_tablet_manager.cc:1428] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:53.744580 2841 ts_tablet_manager.cc:1428] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:53.745306 2840 tablet_bootstrap.cc:492] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: No bootstrap required, opened a new log
I20260929 22:54:53.745347 2840 ts_tablet_manager.cc:1397] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:53.745421 2840 raft_consensus.cc:348] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.745469 2840 raft_consensus.cc:374] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.745482 2840 raft_consensus.cc:729] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.745540 2840 consensus_queue.cc:260] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.745637 2840 ts_tablet_manager.cc:1428] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:53.851720 2844 raft_consensus.cc:482] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:53.851850 2844 raft_consensus.cc:504] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.852075 2844 leader_election.cc:288] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:53.852330 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d9cd51ad9e4f53b81e72e5530b676c" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0" is_pre_election: true
I20260929 22:54:53.852425 2533 raft_consensus.cc:2454] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:53.852360 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d9cd51ad9e4f53b81e72e5530b676c" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" is_pre_election: true
I20260929 22:54:53.852548 2673 raft_consensus.cc:2454] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:53.852627 2323 leader_election.cc:302] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:53.852766 2844 raft_consensus.cc:2781] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:53.852814 2844 raft_consensus.cc:482] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:53.852836 2844 raft_consensus.cc:3037] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.853590 2844 raft_consensus.cc:504] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.853724 2844 leader_election.cc:288] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Requested vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:53.853852 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d9cd51ad9e4f53b81e72e5530b676c" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0"
I20260929 22:54:53.853925 2533 raft_consensus.cc:3037] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.853890 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d9cd51ad9e4f53b81e72e5530b676c" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
I20260929 22:54:53.853960 2673 raft_consensus.cc:3037] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.854547 2533 raft_consensus.cc:2454] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:53.854749 2673 raft_consensus.cc:2454] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:53.854753 2323 leader_election.cc:302] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:53.854883 2844 raft_consensus.cc:2781] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:53.855047 2844 raft_consensus.cc:686] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 1 LEADER]: Becoming Leader. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Running, Role: LEADER
I20260929 22:54:53.855094 2844 consensus_queue.cc:237] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.855749 2232 catalog_manager.cc:5495] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 reported cstate change: term changed from 0 to 1, leader changed from <none> to de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "de13bf2936b644a3916f5b1e9c9aa384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } health_report { overall_health: UNKNOWN } } }
I20260929 22:54:53.891336 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:53.888977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57184 (local address 127.0.124.129:40893)
0929 22:54:53.889134 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:53.889136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:53.889142 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:54:53.889166 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:53.889167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:53.889176 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:53.889252 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:54:53.889366 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:53.889828 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:53.890628 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:53.890847 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:53.890920 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:53.891073 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:54:53.891105 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:54:53.891173 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:53.891226 (+ 53us) server_negotiation.cc:299] Negotiation successful
0929 22:54:53.891246 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260929 22:54:53.893383 2673 raft_consensus.cc:1261] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:53.893431 2533 raft_consensus.cc:1261] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:53.893596 2846 consensus_queue.cc:1035] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:53.893705 2844 consensus_queue.cc:1035] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:53.894681 2809 mvcc.cc:205] Tried to move back new op lower bound from 7334799334986113024 to 7334799334831054848. Current Snapshot: MvccSnapshot[applied={T|T < 7334799334986113024}]
I20260929 22:54:53.903038 2232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:53.903134 2232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:53.903749 2232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Sending DeleteTablet for 3 replicas of tablet f0d9cd51ad9e4f53b81e72e5530b676c
I20260929 22:54:53.903977 2373 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:59644
I20260929 22:54:53.904021 2513 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:36434
I20260929 22:54:53.904135 2828 tablet_replica.cc:330] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: stopping tablet replica
I20260929 22:54:53.904147 2829 tablet_replica.cc:330] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: stopping tablet replica
I20260929 22:54:53.904212 2828 raft_consensus.cc:2229] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:54:53.904246 2829 raft_consensus.cc:2229] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:53.904284 2829 raft_consensus.cc:2258] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.904294 2828 raft_consensus.cc:2258] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.904481 2653 tablet_service.cc:1514] Processing DeleteTablet for tablet f0d9cd51ad9e4f53b81e72e5530b676c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:53 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:52396
I20260929 22:54:53.904556 2828 ts_tablet_manager.cc:1905] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.904596 2830 tablet_replica.cc:330] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: stopping tablet replica
I20260929 22:54:53.904655 2830 raft_consensus.cc:2229] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:53.904691 2830 raft_consensus.cc:2258] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:53.904803 2232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:54:53.904935 2232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:54:53.904970 2830 ts_tablet_manager.cc:1905] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.906139 2828 ts_tablet_manager.cc:1918] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:53.906189 2828 log.cc:1196] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/f0d9cd51ad9e4f53b81e72e5530b676c
I20260929 22:54:53.906195 2373 tablet_service.cc:1467] Processing CreateTablet for tablet 9b0e596173684b67bec7a8f8817d5058 (DEFAULT_TABLE table=test-table [id=74d54e1d00be4150aafbfadd292e3d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.906354 2373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b0e596173684b67bec7a8f8817d5058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.906418 2828 ts_tablet_manager.cc:1939] T f0d9cd51ad9e4f53b81e72e5530b676c P de13bf2936b644a3916f5b1e9c9aa384: Deleting consensus metadata
I20260929 22:54:53.906419 2830 ts_tablet_manager.cc:1918] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:53.906456 2830 log.cc:1196] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/f0d9cd51ad9e4f53b81e72e5530b676c
I20260929 22:54:53.906642 2830 ts_tablet_manager.cc:1939] T f0d9cd51ad9e4f53b81e72e5530b676c P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting consensus metadata
I20260929 22:54:53.906855 2829 ts_tablet_manager.cc:1905] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:53.907406 2839 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384: Bootstrap starting.
I20260929 22:54:53.907498 2513 tablet_service.cc:1467] Processing CreateTablet for tablet 9b0e596173684b67bec7a8f8817d5058 (DEFAULT_TABLE table=test-table [id=74d54e1d00be4150aafbfadd292e3d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.907589 2513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b0e596173684b67bec7a8f8817d5058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.907704 2839 tablet_bootstrap.cc:654] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.908277 2839 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384: No bootstrap required, opened a new log
I20260929 22:54:53.908272 2829 ts_tablet_manager.cc:1918] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:54:53.908327 2829 log.cc:1196] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/f0d9cd51ad9e4f53b81e72e5530b676c
I20260929 22:54:53.908327 2839 ts_tablet_manager.cc:1397] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:53.908429 2839 raft_consensus.cc:348] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.908519 2839 raft_consensus.cc:374] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.908535 2829 ts_tablet_manager.cc:1939] T f0d9cd51ad9e4f53b81e72e5530b676c P 235411a761264b859acfdda1a4206fb0: Deleting consensus metadata
I20260929 22:54:53.908542 2839 raft_consensus.cc:729] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.908591 2839 consensus_queue.cc:260] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.908694 2839 ts_tablet_manager.cc:1428] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:53.908882 2840 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Bootstrap starting.
I20260929 22:54:53.909010 2218 catalog_manager.cc:4841] TS 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325): tablet f0d9cd51ad9e4f53b81e72e5530b676c (table test-table [id=6856838721d24283ac9b960b7d2eed1c]) successfully deleted
I20260929 22:54:53.909207 2840 tablet_bootstrap.cc:654] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.909256 2218 catalog_manager.cc:4841] TS c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109): tablet f0d9cd51ad9e4f53b81e72e5530b676c (table test-table [id=6856838721d24283ac9b960b7d2eed1c]) successfully deleted
I20260929 22:54:53.909267 2653 tablet_service.cc:1467] Processing CreateTablet for tablet 9b0e596173684b67bec7a8f8817d5058 (DEFAULT_TABLE table=test-table [id=74d54e1d00be4150aafbfadd292e3d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:54:53.909368 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b0e596173684b67bec7a8f8817d5058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:53.909528 2218 catalog_manager.cc:4841] TS de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893): tablet f0d9cd51ad9e4f53b81e72e5530b676c (table test-table [id=6856838721d24283ac9b960b7d2eed1c]) successfully deleted
I20260929 22:54:53.909744 2840 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: No bootstrap required, opened a new log
I20260929 22:54:53.909808 2840 ts_tablet_manager.cc:1397] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:53.909909 2840 raft_consensus.cc:348] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.909984 2840 raft_consensus.cc:374] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.910007 2840 raft_consensus.cc:729] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235411a761264b859acfdda1a4206fb0, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.910059 2840 consensus_queue.cc:260] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.910154 2840 ts_tablet_manager.cc:1428] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:53.910499 2841 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Bootstrap starting.
I20260929 22:54:53.910815 2841 tablet_bootstrap.cc:654] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:53.911315 2841 tablet_bootstrap.cc:492] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: No bootstrap required, opened a new log
I20260929 22:54:53.911355 2841 ts_tablet_manager.cc:1397] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 22:54:53.911437 2841 raft_consensus.cc:348] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.911512 2841 raft_consensus.cc:374] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:53.911544 2841 raft_consensus.cc:729] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5932bd1b344028e2a4e3ffb234bc1, State: Initialized, Role: FOLLOWER
I20260929 22:54:53.911587 2841 consensus_queue.cc:260] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.911679 2841 ts_tablet_manager.cc:1428] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:53.913096 2844 raft_consensus.cc:482] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:54:53.913143 2844 raft_consensus.cc:504] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.913260 2844 leader_election.cc:288] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:53.913357 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b0e596173684b67bec7a8f8817d5058" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0" is_pre_election: true
I20260929 22:54:53.913426 2533 raft_consensus.cc:2454] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:53.913394 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b0e596173684b67bec7a8f8817d5058" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" is_pre_election: true
I20260929 22:54:53.913458 2673 raft_consensus.cc:2454] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 0.
I20260929 22:54:53.913544 2323 leader_election.cc:302] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:53.913656 2844 raft_consensus.cc:2781] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:54:53.913702 2844 raft_consensus.cc:482] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:54:53.913725 2844 raft_consensus.cc:3037] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.914212 2844 raft_consensus.cc:504] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.914323 2844 leader_election.cc:288] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Requested vote from peers 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325), c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109)
I20260929 22:54:53.914423 2533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b0e596173684b67bec7a8f8817d5058" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235411a761264b859acfdda1a4206fb0"
I20260929 22:54:53.914451 2673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b0e596173684b67bec7a8f8817d5058" candidate_uuid: "de13bf2936b644a3916f5b1e9c9aa384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1"
I20260929 22:54:53.914495 2533 raft_consensus.cc:3037] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.914503 2673 raft_consensus.cc:3037] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:53.915077 2533 raft_consensus.cc:2454] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:53.915077 2673 raft_consensus.cc:2454] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de13bf2936b644a3916f5b1e9c9aa384 in term 1.
I20260929 22:54:53.915226 2323 leader_election.cc:302] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235411a761264b859acfdda1a4206fb0, de13bf2936b644a3916f5b1e9c9aa384; no voters:
I20260929 22:54:53.915320 2844 raft_consensus.cc:2781] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:53.915365 2844 raft_consensus.cc:686] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [term 1 LEADER]: Becoming Leader. State: Replica: de13bf2936b644a3916f5b1e9c9aa384, State: Running, Role: LEADER
I20260929 22:54:53.915412 2844 consensus_queue.cc:237] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } }
I20260929 22:54:53.915853 2232 catalog_manager.cc:5495] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 reported cstate change: term changed from 0 to 1, leader changed from <none> to de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "de13bf2936b644a3916f5b1e9c9aa384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de13bf2936b644a3916f5b1e9c9aa384" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 } health_report { overall_health: UNKNOWN } } }
I20260929 22:54:53.921883 2673 raft_consensus.cc:1261] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:53.921913 2533 raft_consensus.cc:1261] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Refusing update from remote peer de13bf2936b644a3916f5b1e9c9aa384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:54:53.922080 2844 consensus_queue.cc:1035] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c5932bd1b344028e2a4e3ffb234bc1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:54:53.922180 2853 consensus_queue.cc:1035] T 9b0e596173684b67bec7a8f8817d5058 P de13bf2936b644a3916f5b1e9c9aa384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235411a761264b859acfdda1a4206fb0" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:54:53.926141 2809 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 22:54:55.442684 2234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:55.442799 2234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:54:55.443544 2234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05e4bb5514894fe7974ce3db73945fb1: Sending DeleteTablet for 3 replicas of tablet 9b0e596173684b67bec7a8f8817d5058
I20260929 22:54:55.443799 2513 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b0e596173684b67bec7a8f8817d5058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:36434
I20260929 22:54:55.443828 2373 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b0e596173684b67bec7a8f8817d5058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:59644
I20260929 22:54:55.443827 2653 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b0e596173684b67bec7a8f8817d5058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:54:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:52396
I20260929 22:54:55.443907 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2307
I20260929 22:54:55.445849 2884 tablet_replica.cc:330] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: stopping tablet replica
I20260929 22:54:55.445940 2884 raft_consensus.cc:2229] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:55.445987 2884 raft_consensus.cc:2258] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:55.446218 2884 ts_tablet_manager.cc:1905] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:54:55.447399 2883 tablet_replica.cc:330] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: stopping tablet replica
I20260929 22:54:55.447518 2883 raft_consensus.cc:2229] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:54:55.447563 2883 raft_consensus.cc:2258] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:54:55.447733 2884 ts_tablet_manager.cc:1918] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:54:55.447788 2884 log.cc:1196] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/9b0e596173684b67bec7a8f8817d5058
I20260929 22:54:55.448040 2884 ts_tablet_manager.cc:1939] T 9b0e596173684b67bec7a8f8817d5058 P c6c5932bd1b344028e2a4e3ffb234bc1: Deleting consensus metadata
I20260929 22:54:55.448381 2218 catalog_manager.cc:4841] TS c6c5932bd1b344028e2a4e3ffb234bc1 (127.0.124.131:45109): tablet 9b0e596173684b67bec7a8f8817d5058 (table test-table [id=74d54e1d00be4150aafbfadd292e3d90]) successfully deleted
I20260929 22:54:55.448422 2883 ts_tablet_manager.cc:1905] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:54:55.449586 2218 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:40893 (error 108)
I20260929 22:54:55.449816 2883 ts_tablet_manager.cc:1918] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:54:55.449875 2883 log.cc:1196] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/9b0e596173684b67bec7a8f8817d5058
I20260929 22:54:55.450088 2883 ts_tablet_manager.cc:1939] T 9b0e596173684b67bec7a8f8817d5058 P 235411a761264b859acfdda1a4206fb0: Deleting consensus metadata
W20260929 22:54:55.450181 2887 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:54:55.449936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40893 (local address 127.0.0.1:57186)
0929 22:54:55.450056 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:55.450099 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:40893: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":79,"threads_started":1}
W20260929 22:54:55.450284 2218 catalog_manager.cc:4584] TS de13bf2936b644a3916f5b1e9c9aa384 (127.0.124.129:40893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b0e596173684b67bec7a8f8817d5058: Network error: Client connection negotiation failed: client connection to 127.0.124.129:40893: connect: Connection reset by peer (error 104)
I20260929 22:54:55.450407 2218 catalog_manager.cc:4841] TS 235411a761264b859acfdda1a4206fb0 (127.0.124.130:33325): tablet 9b0e596173684b67bec7a8f8817d5058 (table test-table [id=74d54e1d00be4150aafbfadd292e3d90]) successfully deleted
I20260929 22:54:55.450649 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2448
I20260929 22:54:55.455693 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2588
I20260929 22:54:55.461956 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2202
2026-09-29T22:54:55Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5769 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:55 dist-test-slave-512q krb5kdc[2890](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:55 dist-test-slave-512q krb5kdc[2890](info): set up 2 sockets
Sep 29 22:54:55 dist-test-slave-512q krb5kdc[2890](info): commencing operation
krb5kdc: starting...
W20260929 22:54:56.486300 498 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:56 dist-test-slave-512q krb5kdc[2890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:56.599489 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36157
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36157
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:56.678897 2903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:56.679108 2903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:56.679131 2903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:56.680372 2903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:56.680409 2903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:56.680423 2903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:56.680435 2903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:56.680446 2903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:56.682085 2903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:56.682322 2903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:56.682542 2903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:56.687314 2908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:56.687386 2909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:56.687405 2911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:56.687451 2903 server_base.cc:1034] running on GCE node
I20260929 22:54:56.687829 2903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:56.688108 2903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:56.689275 2903 hybrid_clock.cc:648] HybridClock initialized: now 1790722496689273 us; error 39 us; skew 500 ppm
Sep 29 22:54:56 dist-test-slave-512q krb5kdc[2890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:56.694739 2903 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:56.695096 2903 webserver.cc:460] Webserver started at http://127.0.124.190:45203/ using document root <none> and password file <none>
I20260929 22:54:56.695262 2903 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:56.695299 2903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:56.695379 2903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:56.696422 2903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "d54a613a4b3b5479b1e1bd03a98853f4"
server_key_iv: "405ae51b2e0be8eb92ee696a47ce932d"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.696727 2903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "d54a613a4b3b5479b1e1bd03a98853f4"
server_key_iv: "405ae51b2e0be8eb92ee696a47ce932d"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.697888 2903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:56.698520 2918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:56.698688 2903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:56.698773 2903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "d54a613a4b3b5479b1e1bd03a98853f4"
server_key_iv: "405ae51b2e0be8eb92ee696a47ce932d"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.698823 2903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:56.711342 2903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:56.713094 2903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:56.713195 2903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:56.716876 2903 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:36157
I20260929 22:54:56.716922 2970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:36157 every 8 connection(s)
I20260929 22:54:56.717368 2903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:56.718040 2971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:56.720101 2971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2: Bootstrap starting.
I20260929 22:54:56.720670 2971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:56.720952 2971 log.cc:824] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:56.721592 2971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2: No bootstrap required, opened a new log
I20260929 22:54:56.723100 2971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } }
I20260929 22:54:56.723263 2971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:56.723309 2971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6fdf2abeb24268b0f8399ee9b73ef2, State: Initialized, Role: FOLLOWER
I20260929 22:54:56.723502 2971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } }
I20260929 22:54:56.723585 2971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:56.723575 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2903
I20260929 22:54:56.723625 2971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:56.723675 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:56.723677 2971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:56.723863 498 external_mini_cluster.cc:1428] Setting key ff604b1061117e539bcb972983a279de
I20260929 22:54:56.724812 2971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } }
I20260929 22:54:56.724925 2971 leader_election.cc:302] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b6fdf2abeb24268b0f8399ee9b73ef2; no voters:
I20260929 22:54:56.725086 2971 leader_election.cc:288] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:56.725118 2976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:56.725324 2976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [term 1 LEADER]: Becoming Leader. State: Replica: 1b6fdf2abeb24268b0f8399ee9b73ef2, State: Running, Role: LEADER
I20260929 22:54:56.725363 2971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:56.725458 2976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } }
I20260929 22:54:56.725855 2977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } } }
I20260929 22:54:56.725941 2977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:56.726298 2983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:56.726765 2983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:56.727082 2978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b6fdf2abeb24268b0f8399ee9b73ef2. Latest consensus state: current_term: 1 leader_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6fdf2abeb24268b0f8399ee9b73ef2" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36157 } } }
I20260929 22:54:56.727438 2978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:56.728892 2983 catalog_manager.cc:1347] Generated new cluster ID: 2dc0a8ee00a448af9e48f0522801d019
I20260929 22:54:56.728942 2983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:54:56 dist-test-slave-512q krb5kdc[2890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:56.734208 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:56.724333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.0.124.190:36157)
0929 22:54:56.724512 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:56.724521 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:56.724569 (+ 48us) server_negotiation.cc:407] Connection header received
0929 22:54:56.724653 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:56.724658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:56.724696 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:56.724798 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:56.725676 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.727184 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.727989 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.728581 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.728690 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:56.730868 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:56.730872 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:56.730873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:56.730883 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:56.732633 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:56.732997 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:56.733001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:56.733001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:56.733100 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:56.733320 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:56.733321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:56.733321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:56.733591 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:56.733754 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:56.733846 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:54:56.734078 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
I20260929 22:54:56.735719 2983 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:56.736421 2983 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:56.738544 2983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b6fdf2abeb24268b0f8399ee9b73ef2: Generated new TSK 0
I20260929 22:54:56.738693 2983 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:56.765161 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:56.845359 2997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:56.845557 2997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:56.845579 2997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:56.846669 2997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:56.846707 2997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:56.846732 2997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:56.848186 2997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:56.848435 2997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:56.848664 2997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:56.854328 3003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:56.854353 3005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:56.854606 3002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:56.854642 2997 server_base.cc:1034] running on GCE node
I20260929 22:54:56.854877 2997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:56.855113 2997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:56.856272 2997 hybrid_clock.cc:648] HybridClock initialized: now 1790722496856250 us; error 36 us; skew 500 ppm
Sep 29 22:54:56 dist-test-slave-512q krb5kdc[2890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:56.858498 2997 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:56.858896 2997 webserver.cc:460] Webserver started at http://127.0.124.129:45179/ using document root <none> and password file <none>
I20260929 22:54:56.859127 2997 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:56.859169 2997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:56.859252 2997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:56.860234 2997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "7d65c3d109164d5bb3a1269a6d7ea6ee"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "a936063d46d254271d8801c21a77c9ff"
server_key_iv: "92a1b54b91474ae119cc99bd3058d609"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.860546 2997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "7d65c3d109164d5bb3a1269a6d7ea6ee"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "a936063d46d254271d8801c21a77c9ff"
server_key_iv: "92a1b54b91474ae119cc99bd3058d609"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.861778 2997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:54:56.862423 3012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:56.862653 2997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:54:56.862743 2997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "7d65c3d109164d5bb3a1269a6d7ea6ee"
format_stamp: "Formatted at 2026-09-29 22:54:56 on dist-test-slave-512q"
server_key: "a936063d46d254271d8801c21a77c9ff"
server_key_iv: "92a1b54b91474ae119cc99bd3058d609"
server_key_version: "encryptionkey@0"
I20260929 22:54:56.862840 2997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:56.884761 2997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:56.886600 2997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:56.886750 2997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:56.886981 2997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:56.887293 2997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:56.887326 2997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:56.887346 2997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:56.887391 2997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:56.892923 2997 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:32863
I20260929 22:54:56.893008 3125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:32863 every 8 connection(s)
I20260929 22:54:56.893316 2997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:54:56 dist-test-slave-512q krb5kdc[2890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:56.899577 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 2997
I20260929 22:54:56.899679 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:54:56.899864 498 external_mini_cluster.cc:1428] Setting key 831c2c176cf87e0d37a22be8305de3d5
I20260929 22:54:56.903168 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:56.894075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:33033 (local address 127.0.124.190:36157)
0929 22:54:56.894135 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:56.894137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:56.894334 (+ 197us) server_negotiation.cc:407] Connection header received
0929 22:54:56.895293 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:56.895294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:56.895309 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:56.895358 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:56.895967 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.896562 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.897560 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.897774 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.897860 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:56.900170 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:56.900172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:56.900172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:56.900182 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:56.901743 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:56.902169 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:56.902170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:56.902171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:56.902231 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:56.902505 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:56.902506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:56.902506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:56.902621 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:56.902695 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:56.902995 (+ 300us) server_negotiation.cc:299] Negotiation successful
0929 22:54:56.903082 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:54:56.903367 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:56.894047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36157 (local address 127.0.124.129:33033)
0929 22:54:56.894221 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:56.894256 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:56.895183 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:56.895431 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:56.895435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:56.895684 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:56.895866 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:56.895870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.896654 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.896655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:56.897467 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:56.897469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:56.897870 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:56.897871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:56.897998 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:56.898561 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:56.898569 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:56.900040 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:56.901827 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:56.901833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:56.901835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:56.902085 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:56.902324 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:56.902325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:56.902325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:56.902430 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:56.902711 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:56.902717 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:56.902850 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:54:56.902962 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:54:56.903113 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260929 22:54:56.903908 3126 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36157
I20260929 22:54:56.904017 3126 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:56.904241 3126 heartbeater.cc:511] Master 127.0.124.190:36157 requested a full tablet report, sending...
I20260929 22:54:56.904752 2935 ts_manager.cc:194] Registered new tserver with Master: 7d65c3d109164d5bb3a1269a6d7ea6ee (127.0.124.129:32863)
I20260929 22:54:56.905341 2935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:33033
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:54:56.923302 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:57.001114 3131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:57.001365 3131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:57.001402 3131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:57.002681 3131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:57.002743 3131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:57.002790 3131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:54:57.004325 3131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:57.004608 3131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:57.004827 3131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:57.009913 3137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:57.009984 3136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:57.009914 3139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:57.010219 3131 server_base.cc:1034] running on GCE node
I20260929 22:54:57.010483 3131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:57.010692 3131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:57.011857 3131 hybrid_clock.cc:648] HybridClock initialized: now 1790722497011839 us; error 29 us; skew 500 ppm
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[2890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:57.014467 3131 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:54:57.014842 3131 webserver.cc:460] Webserver started at http://127.0.124.130:34677/ using document root <none> and password file <none>
I20260929 22:54:57.015035 3131 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:57.015074 3131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:57.015156 3131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:57.016069 3131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "8afc7a0e8b144b6aac47d5d695537a1c"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9df95f8173443064afd5eb57d0ea4080"
server_key_iv: "d70671fc2b734fc2e3357ba8ed60823f"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.016427 3131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "8afc7a0e8b144b6aac47d5d695537a1c"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9df95f8173443064afd5eb57d0ea4080"
server_key_iv: "d70671fc2b734fc2e3357ba8ed60823f"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.017777 3131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:54:57.018442 3146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.018635 3131 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.018746 3131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "8afc7a0e8b144b6aac47d5d695537a1c"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9df95f8173443064afd5eb57d0ea4080"
server_key_iv: "d70671fc2b734fc2e3357ba8ed60823f"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.018827 3131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:57.045279 3131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:57.047602 3131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:57.047770 3131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:57.047981 3131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:57.048370 3131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:57.048412 3131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.048435 3131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:57.048477 3131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.054119 3131 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:35311
I20260929 22:54:57.054167 3261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:35311 every 8 connection(s)
I20260929 22:54:57.054477 3131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:54:57.057978 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3131
I20260929 22:54:57.058058 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:54:57.058267 498 external_mini_cluster.cc:1428] Setting key b7d375ab596e1a4e85ffc17dfac06aaa
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[2890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:57.064073 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:57.055226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:59993 (local address 127.0.124.190:36157)
0929 22:54:57.055309 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:57.055316 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:57.055453 (+ 137us) server_negotiation.cc:407] Connection header received
0929 22:54:57.056499 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:57.056501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:57.056511 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:57.056582 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:57.057141 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.057692 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.058867 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.059081 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.059161 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:57.061273 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:57.061275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:57.061275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:57.061282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:57.062714 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:57.063124 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:57.063125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:57.063125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:57.063185 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:57.063441 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:57.063442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:57.063442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:57.063552 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:57.063631 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:57.063898 (+ 267us) server_negotiation.cc:299] Negotiation successful
0929 22:54:57.063984 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 22:54:57.064273 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:57.055165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36157 (local address 127.0.124.130:59993)
0929 22:54:57.055331 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:57.055371 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:57.056373 (+ 1002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:57.056636 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:57.056639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:57.056872 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:57.057061 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:57.057065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.057769 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.057770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:57.058779 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:57.058782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.059186 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.059187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:57.059313 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:57.059838 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:57.059845 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:57.061164 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:57.062815 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:57.062821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:57.062824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:57.063047 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:57.063251 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:57.063252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:57.063253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:57.063362 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:57.063620 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:57.063626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:57.063763 (+ 137us) client_negotiation.cc:769] Sending connection context
0929 22:54:57.063863 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:54:57.064025 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260929 22:54:57.064745 3262 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36157
I20260929 22:54:57.064823 3262 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:57.065022 3262 heartbeater.cc:511] Master 127.0.124.190:36157 requested a full tablet report, sending...
I20260929 22:54:57.065416 2935 ts_manager.cc:194] Registered new tserver with Master: 8afc7a0e8b144b6aac47d5d695537a1c (127.0.124.130:35311)
I20260929 22:54:57.066011 2935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:59993
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:54:57.084522 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:57.163661 3267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:57.163913 3267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:57.163951 3267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:57.165135 3267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:57.165199 3267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:57.165263 3267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:54:57.166853 3267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:57.167096 3267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:57.167315 3267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:57.172096 3272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:57.172106 3275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:57.172327 3267 server_base.cc:1034] running on GCE node
W20260929 22:54:57.172176 3273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:57.172701 3267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:57.172961 3267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:57.174118 3267 hybrid_clock.cc:648] HybridClock initialized: now 1790722497174116 us; error 39 us; skew 500 ppm
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[2890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:57.176568 3267 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:54:57.176959 3267 webserver.cc:460] Webserver started at http://127.0.124.131:46173/ using document root <none> and password file <none>
I20260929 22:54:57.177175 3267 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:57.177240 3267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:57.177386 3267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:57.178416 3267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "ab088a0b0cb84f3db36183a729d6bde0"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9f204d05aed4c6333651a82d746f21ce"
server_key_iv: "52abc0577ff3bac37b7a8dc62fb15908"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.178766 3267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "ab088a0b0cb84f3db36183a729d6bde0"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9f204d05aed4c6333651a82d746f21ce"
server_key_iv: "52abc0577ff3bac37b7a8dc62fb15908"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.180018 3267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:54:57.180742 3282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.180907 3267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.180999 3267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "ab088a0b0cb84f3db36183a729d6bde0"
format_stamp: "Formatted at 2026-09-29 22:54:57 on dist-test-slave-512q"
server_key: "9f204d05aed4c6333651a82d746f21ce"
server_key_iv: "52abc0577ff3bac37b7a8dc62fb15908"
server_key_version: "encryptionkey@0"
I20260929 22:54:57.181097 3267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:57.203617 3267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:57.205492 3267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:57.205655 3267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:57.205888 3267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:54:57.206223 3267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:54:57.206280 3267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.206321 3267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:54:57.206349 3267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:57.211951 3267 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:41967
I20260929 22:54:57.212000 3397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:41967 every 8 connection(s)
I20260929 22:54:57.212411 3267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[2890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:57.218739 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3267
I20260929 22:54:57.218845 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:54:57.219084 498 external_mini_cluster.cc:1428] Setting key b50a672f84feec191c7b82075e450be4
I20260929 22:54:57.221211 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:57.213113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:50029 (local address 127.0.124.190:36157)
0929 22:54:57.213181 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:57.213182 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:57.213367 (+ 185us) server_negotiation.cc:407] Connection header received
0929 22:54:57.214252 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:57.214253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:57.214263 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:57.214318 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:57.214842 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.215371 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.216308 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.216481 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.216533 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:57.218416 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:57.218417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:57.218418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:57.218424 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:57.220103 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:57.220495 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:57.220496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:57.220497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:57.220547 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:57.220723 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:57.220723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:57.220724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:57.220816 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:57.220865 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:57.221095 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 22:54:57.221152 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:54:57.221366 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:57.213086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36157 (local address 127.0.124.131:50029)
0929 22:54:57.213225 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:54:57.213266 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:54:57.214163 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:54:57.214368 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:54:57.214371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:54:57.214601 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:54:57.214773 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:57.214777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.215446 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.215446 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:57.216191 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:54:57.216193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:54:57.216549 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:54:57.216550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:54:57.216643 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:57.217039 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:54:57.217046 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:54:57.218309 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:54:57.220163 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:57.220168 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:57.220169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:57.220412 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:57.220587 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:54:57.220587 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:54:57.220587 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:54:57.220673 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:54:57.220871 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:54:57.220874 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:54:57.220986 (+ 112us) client_negotiation.cc:769] Sending connection context
0929 22:54:57.221063 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:54:57.221177 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260929 22:54:57.221884 3398 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36157
I20260929 22:54:57.221963 3398 heartbeater.cc:464] Registering TS with master...
I20260929 22:54:57.222093 3398 heartbeater.cc:511] Master 127.0.124.190:36157 requested a full tablet report, sending...
I20260929 22:54:57.222411 2935 ts_manager.cc:194] Registered new tserver with Master: ab088a0b0cb84f3db36183a729d6bde0 (127.0.124.131:41967)
I20260929 22:54:57.222797 2935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:50029
I20260929 22:54:57.230804 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:54:57.242203 2975 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:54:57.241217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46112 (local address 127.0.124.190:36157)
0929 22:54:57.241300 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:57.241302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:57.241397 (+ 95us) server_negotiation.cc:407] Connection header received
0929 22:54:57.241496 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:57.241497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:57.241506 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:57.241577 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:57.242128 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46112: BlockingRecv error: recv got EOF from 127.0.0.1:46112 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:54:57.243065 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2997
I20260929 22:54:57.247219 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3131
I20260929 22:54:57.251219 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3267
I20260929 22:54:57.255244 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 2903
2026-09-29T22:54:57Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1792 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[3410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[3410](info): set up 2 sockets
Sep 29 22:54:57 dist-test-slave-512q krb5kdc[3410](info): commencing operation
krb5kdc: starting...
W20260929 22:54:58.294289 498 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:58.410251 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:32935
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:35123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:32935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:58.489171 3423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:58.489357 3423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:58.489378 3423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:58.490525 3423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:58.490566 3423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:58.490581 3423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:58.490592 3423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:58.490643 3423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:58.492062 3423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:35123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:32935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:32935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:58.492341 3423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:58.492563 3423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:58.497228 3431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:58.497228 3428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:58.497390 3423 server_base.cc:1034] running on GCE node
W20260929 22:54:58.497517 3429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:58.497792 3423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:58.498080 3423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:58.499241 3423 hybrid_clock.cc:648] HybridClock initialized: now 1790722498499221 us; error 38 us; skew 500 ppm
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:58.501573 3423 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:58.502020 3423 webserver.cc:460] Webserver started at http://127.0.124.190:43193/ using document root <none> and password file <none>
I20260929 22:54:58.502270 3423 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:58.502315 3423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:58.502476 3423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:58.503479 3423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "8f6ce199fe394190bebf950b4d23001a"
format_stamp: "Formatted at 2026-09-29 22:54:58 on dist-test-slave-512q"
server_key: "7d093df6612a8c20d5b32417f717c70a"
server_key_iv: "e987533a85baa5b06bfe544504c0a444"
server_key_version: "encryptionkey@0"
I20260929 22:54:58.503806 3423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "8f6ce199fe394190bebf950b4d23001a"
format_stamp: "Formatted at 2026-09-29 22:54:58 on dist-test-slave-512q"
server_key: "7d093df6612a8c20d5b32417f717c70a"
server_key_iv: "e987533a85baa5b06bfe544504c0a444"
server_key_version: "encryptionkey@0"
I20260929 22:54:58.505290 3423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:54:58.505935 3438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:58.506101 3423 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:58.506201 3423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "8f6ce199fe394190bebf950b4d23001a"
format_stamp: "Formatted at 2026-09-29 22:54:58 on dist-test-slave-512q"
server_key: "7d093df6612a8c20d5b32417f717c70a"
server_key_iv: "e987533a85baa5b06bfe544504c0a444"
server_key_version: "encryptionkey@0"
I20260929 22:54:58.506270 3423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:58.521942 3423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:58.523715 3423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:58.523875 3423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:58.527832 3423 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:32935
I20260929 22:54:58.527866 3491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:32935 every 8 connection(s)
I20260929 22:54:58.528404 3423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:58.529242 3492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:58.531479 3492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: Bootstrap starting.
I20260929 22:54:58.532045 3492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:58.532411 3492 log.cc:824] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:58.533039 3492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: No bootstrap required, opened a new log
I20260929 22:54:58.534536 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3423
I20260929 22:54:58.534622 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:58.534817 498 external_mini_cluster.cc:1428] Setting key 572317dc4b00a60aff990e3ddd3ded20
I20260929 22:54:58.534720 3492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } }
I20260929 22:54:58.534869 3492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:58.534914 3492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f6ce199fe394190bebf950b4d23001a, State: Initialized, Role: FOLLOWER
I20260929 22:54:58.535086 3492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } }
I20260929 22:54:58.535164 3492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:58.535220 3492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:58.535274 3492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:58.535975 3492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } }
I20260929 22:54:58.536135 3492 leader_election.cc:302] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f6ce199fe394190bebf950b4d23001a; no voters:
I20260929 22:54:58.536322 3492 leader_election.cc:288] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:58.536347 3497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:58.536448 3497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [term 1 LEADER]: Becoming Leader. State: Replica: 8f6ce199fe394190bebf950b4d23001a, State: Running, Role: LEADER
I20260929 22:54:58.536576 3492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:58.536585 3497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } }
I20260929 22:54:58.538411 3498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f6ce199fe394190bebf950b4d23001a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } } }
I20260929 22:54:58.538534 3498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:58.538406 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f6ce199fe394190bebf950b4d23001a. Latest consensus state: current_term: 1 leader_uuid: "8f6ce199fe394190bebf950b4d23001a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6ce199fe394190bebf950b4d23001a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 32935 } } }
I20260929 22:54:58.538597 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a [sys.catalog]: This master's current role is: LEADER
W20260929 22:54:58.538652 3512 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:54:58.538755 3512 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:54:58.538823 3514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:58.538968 3514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:58.540477 3514 catalog_manager.cc:1347] Generated new cluster ID: cfd969230dd14b028b3d9c3e2405f803
I20260929 22:54:58.540537 3514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:58.546545 3496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:58.535250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36626 (local address 127.0.124.190:32935)
0929 22:54:58.535792 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:58.535799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:58.535823 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:54:58.535908 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:58.535913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:58.535952 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:58.536129 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:58.536924 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:58.538180 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:58.539255 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:58.539918 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:58.540048 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:58.542948 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:58.542951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:58.542952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:58.542963 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:58.544963 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:58.545331 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:58.545334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:58.545335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:58.545463 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:58.545658 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:58.545659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:58.545659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:58.545965 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:58.546139 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:58.546206 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:54:58.546348 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":451,"threads_started":1}
I20260929 22:54:58.547456 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:54:58.557823 3514 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:58.558503 3514 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:58.560684 3514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f6ce199fe394190bebf950b4d23001a: Generated new TSK 0
I20260929 22:54:58.560833 3514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:54:58.563289 3496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:58.559341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36642 (local address 127.0.124.190:32935)
0929 22:54:58.559384 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:58.559386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:58.559660 (+ 274us) server_negotiation.cc:407] Connection header received
0929 22:54:58.559726 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:58.559727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:58.559749 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:58.559812 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:58.560244 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:58.560960 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:58.562001 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:58.562194 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:58.562266 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:58.562888 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:58.562889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:58.562889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:54:58.563052 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:58.563066 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:54:58.563072 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:58.563118 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:58.563199 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 22:54:58.563218 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:54:58.565551 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3423
2026-09-29T22:54:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1307 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3525](info): set up 2 sockets
Sep 29 22:54:58 dist-test-slave-512q krb5kdc[3525](info): commencing operation
krb5kdc: starting...
W20260929 22:54:59.606389 498 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:54:59 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:54:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:54:59.725291 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36729
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36729
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:59.804180 3538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:59.804481 3538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:59.804520 3538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:59.805701 3538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:54:59.805764 3538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:59.805787 3538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:59.805821 3538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:54:59.805866 3538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:54:59.807317 3538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:59.807600 3538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:59.807823 3538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:59.812693 3543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:59.812685 3546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:59.812666 3544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:59.813081 3538 server_base.cc:1034] running on GCE node
I20260929 22:54:59.813299 3538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:59.813584 3538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:59.814707 3538 hybrid_clock.cc:648] HybridClock initialized: now 1790722499814685 us; error 36 us; skew 500 ppm
Sep 29 22:54:59 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722499, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:59.817409 3538 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:54:59.818012 3538 webserver.cc:460] Webserver started at http://127.0.124.190:46717/ using document root <none> and password file <none>
I20260929 22:54:59.818305 3538 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:59.818383 3538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:59.818516 3538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:59.820045 3538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "ec7e516a136b4cc5923704854663e317"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "08176c1e45539059dbb16594cef7f3b7"
server_key_iv: "a2dba9727cb0d71712b868995339570c"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.820492 3538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "ec7e516a136b4cc5923704854663e317"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "08176c1e45539059dbb16594cef7f3b7"
server_key_iv: "a2dba9727cb0d71712b868995339570c"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.822281 3538 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:54:59.823041 3553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:59.823210 3538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:59.823302 3538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "ec7e516a136b4cc5923704854663e317"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "08176c1e45539059dbb16594cef7f3b7"
server_key_iv: "a2dba9727cb0d71712b868995339570c"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.823386 3538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:54:59.836885 3538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:54:59.839154 3538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:54:59.839311 3538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:54:59.843325 3538 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:36729
I20260929 22:54:59.843377 3605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:36729 every 8 connection(s)
I20260929 22:54:59.843732 3538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:54:59.844740 3606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:54:59.846863 3606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317: Bootstrap starting.
I20260929 22:54:59.847375 3606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317: Neither blocks nor log segments found. Creating new log.
I20260929 22:54:59.847594 3606 log.cc:824] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317: Log is configured to *not* fsync() on all Append() calls
I20260929 22:54:59.848296 3606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317: No bootstrap required, opened a new log
I20260929 22:54:59.849682 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3538
I20260929 22:54:59.849789 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:54:59.849977 498 external_mini_cluster.cc:1428] Setting key 223d46346f79ba73f19b4fbee4ddd99d
I20260929 22:54:59.850023 3606 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } }
I20260929 22:54:59.850237 3606 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:54:59.850265 3606 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec7e516a136b4cc5923704854663e317, State: Initialized, Role: FOLLOWER
I20260929 22:54:59.850443 3606 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } }
I20260929 22:54:59.850589 3606 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:54:59.850677 3606 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:54:59.850759 3606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:54:59.851581 3606 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } }
I20260929 22:54:59.851698 3606 leader_election.cc:302] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec7e516a136b4cc5923704854663e317; no voters:
I20260929 22:54:59.851897 3606 leader_election.cc:288] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:54:59.851925 3611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:54:59.852028 3611 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [term 1 LEADER]: Becoming Leader. State: Replica: ec7e516a136b4cc5923704854663e317, State: Running, Role: LEADER
I20260929 22:54:59.852150 3606 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:54:59.852159 3611 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } }
I20260929 22:54:59.852617 3612 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec7e516a136b4cc5923704854663e317" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } } }
I20260929 22:54:59.852715 3612 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:59.852643 3613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec7e516a136b4cc5923704854663e317. Latest consensus state: current_term: 1 leader_uuid: "ec7e516a136b4cc5923704854663e317" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec7e516a136b4cc5923704854663e317" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36729 } } }
I20260929 22:54:59.852850 3613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317 [sys.catalog]: This master's current role is: LEADER
I20260929 22:54:59.853235 3619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:54:59.853749 3619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:54:59.855321 3619 catalog_manager.cc:1347] Generated new cluster ID: 96db7564e65f481d84f2b999f9f267d2
I20260929 22:54:59.855376 3619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:54:59 dist-test-slave-512q krb5kdc[3525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:54:59.860306 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:54:59.850527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.0.124.190:36729)
0929 22:54:59.850713 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 22:54:59.850723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:54:59.850754 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:54:59.850873 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:54:59.850887 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:54:59.850927 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:54:59.851066 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:54:59.851681 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:59.853048 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:59.854072 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:54:59.854586 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:54:59.854708 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:54:59.857083 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:54:59.857087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:54:59.857087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:54:59.857098 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:54:59.858738 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:59.859117 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:59.859120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:59.859120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:59.859218 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:54:59.859438 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:54:59.859439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:54:59.859439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:54:59.859666 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:54:59.859841 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0929 22:54:59.859909 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:54:59.860060 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260929 22:54:59.869560 3619 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:54:59.870254 3619 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:54:59.872856 3619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec7e516a136b4cc5923704854663e317: Generated new TSK 0
I20260929 22:54:59.873015 3619 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:54:59.898798 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:54:59.976814 3632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:54:59.977042 3632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:54:59.977077 3632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:54:59.978221 3632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:54:59.978288 3632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:54:59.978333 3632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:54:59.979777 3632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:54:59.980032 3632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:54:59.980270 3632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:54:59.985035 3640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:59.985041 3638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:54:59.985152 3637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:54:59.985400 3632 server_base.cc:1034] running on GCE node
I20260929 22:54:59.985602 3632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:54:59.985841 3632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:54:59.986991 3632 hybrid_clock.cc:648] HybridClock initialized: now 1790722499986981 us; error 27 us; skew 500 ppm
Sep 29 22:54:59 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722499, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:54:59.989470 3632 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:54:59.989917 3632 webserver.cc:460] Webserver started at http://127.0.124.129:39755/ using document root <none> and password file <none>
I20260929 22:54:59.990093 3632 fs_manager.cc:359] Metadata directory not provided
I20260929 22:54:59.990144 3632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:54:59.990231 3632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:54:59.991181 3632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "02caaffdac304da88aaa7c3b8ede622c"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "9ff797457c8ed139f4a6e828a36fef4c"
server_key_iv: "664b41c09c108ecb6ecda73a35d9bf50"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.991519 3632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "02caaffdac304da88aaa7c3b8ede622c"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "9ff797457c8ed139f4a6e828a36fef4c"
server_key_iv: "664b41c09c108ecb6ecda73a35d9bf50"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.992782 3632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:54:59.993532 3648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:54:59.993698 3632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:54:59.993822 3632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "02caaffdac304da88aaa7c3b8ede622c"
format_stamp: "Formatted at 2026-09-29 22:54:59 on dist-test-slave-512q"
server_key: "9ff797457c8ed139f4a6e828a36fef4c"
server_key_iv: "664b41c09c108ecb6ecda73a35d9bf50"
server_key_version: "encryptionkey@0"
I20260929 22:54:59.993896 3632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:00.008554 3632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:00.010901 3632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:00.011075 3632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:00.011310 3632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:00.011620 3632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:00.011672 3632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.011713 3632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:00.011740 3632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.017588 3632 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:33589
I20260929 22:55:00.017645 3763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:33589 every 8 connection(s)
I20260929 22:55:00.017990 3632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:00.023617 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3632
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722499, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:00.023741 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:00.023931 498 external_mini_cluster.cc:1428] Setting key b5ddbd6f56a4fb13de8cc2028945c566
I20260929 22:55:00.027191 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.018729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:49181 (local address 127.0.124.190:36729)
0929 22:55:00.018797 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:00.018799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:00.018992 (+ 193us) server_negotiation.cc:407] Connection header received
0929 22:55:00.019452 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:00.019453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:00.019468 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:00.019522 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:00.020425 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.020937 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.021874 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.022078 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.022134 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.024255 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:00.024256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:00.024257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:00.024264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:00.025743 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.026185 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.026186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.026187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.026248 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.026505 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.026506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.026507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.026634 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:00.026708 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:00.027009 (+ 301us) server_negotiation.cc:299] Negotiation successful
0929 22:55:00.027105 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:55:00.027336 3766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.018710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36729 (local address 127.0.124.129:49181)
0929 22:55:00.018872 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:00.018908 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:00.019371 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:00.019589 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:00.019592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:00.020140 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:00.020350 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.020354 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.021019 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.021019 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.021797 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.021799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.022152 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.022152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.022246 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.022700 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:00.022708 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:00.024145 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:00.025830 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.025837 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.025839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.026106 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.026314 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.026315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.026315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.026436 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.026699 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:00.026705 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:00.026853 (+ 148us) client_negotiation.cc:769] Sending connection context
0929 22:55:00.026965 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:55:00.027116 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260929 22:55:00.027809 3764 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36729
I20260929 22:55:00.027916 3764 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:00.028108 3764 heartbeater.cc:511] Master 127.0.124.190:36729 requested a full tablet report, sending...
I20260929 22:55:00.028705 3570 ts_manager.cc:194] Registered new tserver with Master: 02caaffdac304da88aaa7c3b8ede622c (127.0.124.129:33589)
I20260929 22:55:00.029697 3570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:49181
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:00.048962 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:00.132073 3769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:00.132347 3769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:00.132385 3769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:00.133517 3769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:00.133558 3769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:00.133585 3769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:00.134948 3769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:00.135130 3769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:00.135305 3769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:00.140196 3775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:00.140271 3777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:00.140304 3774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:00.140386 3769 server_base.cc:1034] running on GCE node
I20260929 22:55:00.140690 3769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:00.140933 3769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:00.142097 3769 hybrid_clock.cc:648] HybridClock initialized: now 1790722500142082 us; error 27 us; skew 500 ppm
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:00.144661 3769 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:00.145084 3769 webserver.cc:460] Webserver started at http://127.0.124.130:41433/ using document root <none> and password file <none>
I20260929 22:55:00.145334 3769 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:00.145399 3769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:00.145547 3769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:00.146618 3769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "ba26fa2a3fc241ce9878dd499e6507a7"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "81a700b3a72d56cbc3aec18f07c563ee"
server_key_iv: "dc4bc84772ef7ab094f6dd11950e85b6"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.146965 3769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "ba26fa2a3fc241ce9878dd499e6507a7"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "81a700b3a72d56cbc3aec18f07c563ee"
server_key_iv: "dc4bc84772ef7ab094f6dd11950e85b6"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.148300 3769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:00.149060 3784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.149268 3769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:00.149366 3769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "ba26fa2a3fc241ce9878dd499e6507a7"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "81a700b3a72d56cbc3aec18f07c563ee"
server_key_iv: "dc4bc84772ef7ab094f6dd11950e85b6"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.149474 3769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:00.164974 3769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:00.166700 3769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:00.166850 3769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:00.167089 3769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:00.167387 3769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:00.167447 3769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.167481 3769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:00.167510 3769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.173316 3769 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:40709
I20260929 22:55:00.173367 3897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:40709 every 8 connection(s)
I20260929 22:55:00.173722 3769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:00.173862 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3769
I20260929 22:55:00.173966 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:00.174199 498 external_mini_cluster.cc:1428] Setting key ab8d2a998d077ce1e984eba52def49c4
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:55:00.183884 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.174488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:50601 (local address 127.0.124.190:36729)
0929 22:55:00.174537 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:00.174539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:00.174834 (+ 295us) server_negotiation.cc:407] Connection header received
0929 22:55:00.175515 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:00.175515 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:00.175525 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:00.175564 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:00.176834 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.177312 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.178316 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.178535 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.178636 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.180920 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:00.180921 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:00.180921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:00.180927 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:00.182581 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.182937 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.182938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.182938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.182993 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.183256 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.183257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.183257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.183404 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:00.183470 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:00.183731 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 22:55:00.183805 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:00.184031 3900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.174493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36729 (local address 127.0.124.130:50601)
0929 22:55:00.174666 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:00.174709 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:00.175403 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:00.175631 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:00.175635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:00.176470 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:00.176732 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.176737 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.177413 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.177414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.178250 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.178252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.178645 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.178646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.178779 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.179309 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:00.179317 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:00.180827 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:00.182660 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.182665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.182667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.182873 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.183039 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.183039 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.183040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.183191 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.183498 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:00.183503 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:00.183612 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 22:55:00.183696 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:55:00.183811 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260929 22:55:00.184480 3898 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36729
I20260929 22:55:00.184582 3898 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:00.184787 3898 heartbeater.cc:511] Master 127.0.124.190:36729 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
I20260929 22:55:00.185209 3570 ts_manager.cc:194] Registered new tserver with Master: ba26fa2a3fc241ce9878dd499e6507a7 (127.0.124.130:40709)
I20260929 22:55:00.185591 3570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:50601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:00.199622 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:00.280051 3903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:00.280249 3903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:00.280277 3903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:00.281337 3903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:00.281369 3903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:00.281395 3903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:00.282707 3903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:00.282868 3903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:00.283032 3903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:00.287949 3912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:00.287961 3909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:00.288128 3903 server_base.cc:1034] running on GCE node
W20260929 22:55:00.288277 3910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:00.288512 3903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:00.288717 3903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:00.289878 3903 hybrid_clock.cc:648] HybridClock initialized: now 1790722500289860 us; error 30 us; skew 500 ppm
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:00.292311 3903 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:00.292757 3903 webserver.cc:460] Webserver started at http://127.0.124.131:33511/ using document root <none> and password file <none>
I20260929 22:55:00.292977 3903 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:00.293042 3903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:00.293172 3903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:00.294226 3903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "cf49835e354c407bb37f3e1835783171"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "23327bcce184183560ca96ba3e978c14"
server_key_iv: "704c477db67057a846fd3c86d78e062f"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.294566 3903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "cf49835e354c407bb37f3e1835783171"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "23327bcce184183560ca96ba3e978c14"
server_key_iv: "704c477db67057a846fd3c86d78e062f"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.295836 3903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:00.296590 3919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.296805 3903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.296901 3903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "cf49835e354c407bb37f3e1835783171"
format_stamp: "Formatted at 2026-09-29 22:55:00 on dist-test-slave-512q"
server_key: "23327bcce184183560ca96ba3e978c14"
server_key_iv: "704c477db67057a846fd3c86d78e062f"
server_key_version: "encryptionkey@0"
I20260929 22:55:00.296988 3903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:00.313967 3903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:00.316376 3903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:00.316532 3903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:00.316756 3903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:00.317092 3903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:00.317147 3903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.317180 3903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:00.317207 3903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:00.322886 3903 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:44685
I20260929 22:55:00.322933 4041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:44685 every 8 connection(s)
I20260929 22:55:00.323262 3903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:00.324420 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 3903
I20260929 22:55:00.324530 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:00.324746 498 external_mini_cluster.cc:1428] Setting key 091851e6cbae321f4ae0bc9014bda63e
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:00.332515 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.324003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:42265 (local address 127.0.124.190:36729)
0929 22:55:00.324067 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:00.324069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:00.324268 (+ 199us) server_negotiation.cc:407] Connection header received
0929 22:55:00.324937 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:00.324938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:00.324967 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:00.325021 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:00.326195 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.326729 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.327761 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.327951 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.328005 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.330043 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:00.330044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:00.330044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:00.330050 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:00.331435 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.331767 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.331767 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.331768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.331816 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.332009 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.332009 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.332009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.332104 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:00.332154 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:00.332390 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 22:55:00.332452 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:55:00.332777 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.323986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36729 (local address 127.0.124.131:42265)
0929 22:55:00.324143 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:00.324177 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:00.324816 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:00.325135 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:00.325140 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:00.325881 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:00.326115 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.326120 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.326803 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.326803 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.327692 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:00.327694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.328022 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.328023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:00.328120 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.328631 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:00.328639 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:00.329955 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:00.331505 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.331510 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.331512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.331707 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.331870 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:00.331870 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:00.331870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:00.331958 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:00.332154 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:00.332158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:00.332279 (+ 121us) client_negotiation.cc:769] Sending connection context
0929 22:55:00.332364 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:55:00.332476 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260929 22:55:00.333391 4042 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36729
I20260929 22:55:00.333472 4042 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:00.333668 4042 heartbeater.cc:511] Master 127.0.124.190:36729 requested a full tablet report, sending...
I20260929 22:55:00.334118 3570 ts_manager.cc:194] Registered new tserver with Master: cf49835e354c407bb37f3e1835783171 (127.0.124.131:44685)
I20260929 22:55:00.334506 3570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:42265
I20260929 22:55:00.336447 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[3525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722500, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:00.358999 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:00.351504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.0.124.190:36729)
0929 22:55:00.351589 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:00.351591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:00.351705 (+ 114us) server_negotiation.cc:407] Connection header received
0929 22:55:00.351787 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:00.351788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:00.351801 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:00.351870 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:00.352535 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.353134 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.353985 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:00.354197 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:00.354288 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:00.356519 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:00.356520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:00.356521 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:00.356529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:00.357869 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.358200 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.358201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.358202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.358261 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:00.358452 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:00.358453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:00.358454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:00.358595 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:00.358697 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:00.358803 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:55:00.358878 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260929 22:55:00.359272 3570 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42530
I20260929 22:55:00.359690 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3632
I20260929 22:55:00.364521 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3769
I20260929 22:55:00.368528 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3903
I20260929 22:55:00.374382 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 3538
2026-09-29T22:55:00Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1811 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[4055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[4055](info): set up 2 sockets
Sep 29 22:55:00 dist-test-slave-512q krb5kdc[4055](info): commencing operation
krb5kdc: starting...
W20260929 22:55:01.402343 498 mini_kdc.cc:121] Time spent starting KDC: real 1.008s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:01.516669 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38371
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:38371
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:01.597867 4069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:01.598078 4069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:01.598101 4069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:01.599220 4069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:01.599262 4069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:01.599278 4069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:01.599292 4069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:01.599306 4069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:01.600761 4069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:38371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:01.600961 4069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:01.601123 4069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:01.605901 4078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:01.605939 4076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:01.606048 4069 server_base.cc:1034] running on GCE node
W20260929 22:55:01.605975 4075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:01.606383 4069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:01.606716 4069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:01.607880 4069 hybrid_clock.cc:648] HybridClock initialized: now 1790722501607859 us; error 44 us; skew 500 ppm
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:01.610320 4069 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:01.610734 4069 webserver.cc:460] Webserver started at http://127.0.124.190:40809/ using document root <none> and password file <none>
I20260929 22:55:01.610962 4069 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:01.611030 4069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:01.611173 4069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:01.612159 4069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "fe4a89152f694277850e5ba010fdda1e"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "c5bb28244a643c06cdb3d9dd30ce6d76"
server_key_iv: "74e9f702f4d1076b318acd83dc767845"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.612604 4069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "fe4a89152f694277850e5ba010fdda1e"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "c5bb28244a643c06cdb3d9dd30ce6d76"
server_key_iv: "74e9f702f4d1076b318acd83dc767845"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.613871 4069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:01.614526 4086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.614722 4069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.614825 4069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "fe4a89152f694277850e5ba010fdda1e"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "c5bb28244a643c06cdb3d9dd30ce6d76"
server_key_iv: "74e9f702f4d1076b318acd83dc767845"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.614895 4069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:01.636132 4069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:01.637890 4069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:01.638056 4069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:01.641987 4069 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:38371
I20260929 22:55:01.642020 4142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:38371 every 8 connection(s)
I20260929 22:55:01.642367 4069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:01.643191 4143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:01.645570 4143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e: Bootstrap starting.
I20260929 22:55:01.646167 4143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:01.646462 4143 log.cc:824] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:01.647147 4143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e: No bootstrap required, opened a new log
I20260929 22:55:01.648679 4143 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } }
I20260929 22:55:01.648808 4143 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:01.648851 4143 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe4a89152f694277850e5ba010fdda1e, State: Initialized, Role: FOLLOWER
I20260929 22:55:01.648998 4143 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } }
I20260929 22:55:01.649055 4143 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:01.649108 4143 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:01.649152 4143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:01.649645 4143 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } }
I20260929 22:55:01.649772 4143 leader_election.cc:302] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe4a89152f694277850e5ba010fdda1e; no voters:
I20260929 22:55:01.649953 4143 leader_election.cc:288] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:01.650015 4146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:01.650274 4143 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:01.650481 4146 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [term 1 LEADER]: Becoming Leader. State: Replica: fe4a89152f694277850e5ba010fdda1e, State: Running, Role: LEADER
I20260929 22:55:01.650638 4146 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } }
I20260929 22:55:01.651129 4147 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe4a89152f694277850e5ba010fdda1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } } }
I20260929 22:55:01.651225 4147 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:01.651369 4148 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe4a89152f694277850e5ba010fdda1e. Latest consensus state: current_term: 1 leader_uuid: "fe4a89152f694277850e5ba010fdda1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4a89152f694277850e5ba010fdda1e" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38371 } } }
I20260929 22:55:01.651427 4148 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:01.651471 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4069
I20260929 22:55:01.651413 4155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:01.651573 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:01.651750 498 external_mini_cluster.cc:1428] Setting key ef91020e604e162ce799f3f71ae4475c
I20260929 22:55:01.652247 4155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:01.653890 4155 catalog_manager.cc:1347] Generated new cluster ID: fafe650f69fb457cb5b5b66ff28a271e
I20260929 22:55:01.653944 4155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:01.663427 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:01.652236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.0.124.190:38371)
0929 22:55:01.652421 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:01.652432 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:01.652599 (+ 167us) server_negotiation.cc:407] Connection header received
0929 22:55:01.652862 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:01.652869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:01.652934 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:01.653085 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:01.653832 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.655237 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.656355 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.656967 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.657064 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:01.659850 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:01.659853 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:01.659854 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:01.659865 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:01.661799 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:01.662210 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:01.662213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:01.662213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:01.662310 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:01.662516 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:01.662517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:01.662517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:01.662802 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:01.662939 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:01.663070 (+ 131us) server_negotiation.cc:299] Negotiation successful
0929 22:55:01.663198 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":63,"threads_started":1}
I20260929 22:55:01.672468 4155 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:01.672976 4155 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:01.675954 4155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe4a89152f694277850e5ba010fdda1e: Generated new TSK 0
I20260929 22:55:01.676134 4155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:55:01.704793 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:01.792842 4170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:01.793067 4170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:01.793092 4170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:01.794353 4170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:01.794405 4170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:01.794461 4170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:01.796046 4170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:01.796311 4170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:01.796586 4170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:01.801978 4176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:01.801965 4179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:01.801966 4177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:01.802166 4170 server_base.cc:1034] running on GCE node
I20260929 22:55:01.802378 4170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:01.802601 4170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:01.803759 4170 hybrid_clock.cc:648] HybridClock initialized: now 1790722501803739 us; error 28 us; skew 500 ppm
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:01.811089 4170 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:55:01.811555 4170 webserver.cc:460] Webserver started at http://127.0.124.129:34669/ using document root <none> and password file <none>
I20260929 22:55:01.811740 4170 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:01.811781 4170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:01.811869 4170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:01.812954 4170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "8526bf0f739a4c7ebc9f5914abd6d7b3"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "95731f9dc19a6b1a70fc5e24cdda196f"
server_key_iv: "dd91f532362d75770ecc74a488c16237"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.813263 4170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "8526bf0f739a4c7ebc9f5914abd6d7b3"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "95731f9dc19a6b1a70fc5e24cdda196f"
server_key_iv: "dd91f532362d75770ecc74a488c16237"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.814838 4170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:55:01.815901 4186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.816102 4170 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:01.816258 4170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "8526bf0f739a4c7ebc9f5914abd6d7b3"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "95731f9dc19a6b1a70fc5e24cdda196f"
server_key_iv: "dd91f532362d75770ecc74a488c16237"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.816339 4170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:01.841646 4170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:01.843690 4170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:01.843853 4170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:01.844105 4170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:01.844486 4170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:01.844549 4170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.844585 4170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:01.844612 4170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.850545 4170 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:44401
I20260929 22:55:01.850585 4300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:44401 every 8 connection(s)
I20260929 22:55:01.850962 4170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:01.859858 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4170
I20260929 22:55:01.859970 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:01.860209 498 external_mini_cluster.cc:1428] Setting key bf5935b7ebb041305ad6740ee7f03345
I20260929 22:55:01.861095 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:01.851829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:60593 (local address 127.0.124.190:38371)
0929 22:55:01.851909 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:01.851911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:01.852055 (+ 144us) server_negotiation.cc:407] Connection header received
0929 22:55:01.853102 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:01.853103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:01.853118 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:01.853194 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:01.853788 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.854782 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.855893 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.856107 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.856170 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:01.858255 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:01.858256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:01.858256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:01.858283 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:01.859514 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:01.859992 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:01.859993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:01.859994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:01.860073 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:01.860414 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:01.860415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:01.860415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:01.860581 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:01.860655 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:01.860911 (+ 256us) server_negotiation.cc:299] Negotiation successful
0929 22:55:01.861008 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:55:01.861276 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:01.851763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38371 (local address 127.0.124.129:60593)
0929 22:55:01.851931 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:01.851973 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:01.852973 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:01.853250 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:01.853253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:01.853503 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:01.853700 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:01.853704 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.854924 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.854925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:01.855799 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:01.855801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:01.856187 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:01.856188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:01.856372 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:01.856831 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:01.856839 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:01.858172 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:01.859582 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:01.859587 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:01.859589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:01.859900 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:01.860154 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:01.860155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:01.860155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:01.860320 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:01.860645 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:01.860650 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:01.860763 (+ 113us) client_negotiation.cc:769] Sending connection context
0929 22:55:01.860870 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 22:55:01.861022 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260929 22:55:01.861781 4301 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38371
I20260929 22:55:01.861892 4301 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:01.862068 4301 heartbeater.cc:511] Master 127.0.124.190:38371 requested a full tablet report, sending...
I20260929 22:55:01.862594 4104 ts_manager.cc:194] Registered new tserver with Master: 8526bf0f739a4c7ebc9f5914abd6d7b3 (127.0.124.129:44401)
I20260929 22:55:01.863548 4104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:60593
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:01.886984 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:01.970242 4306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:01.970464 4306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:01.970500 4306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:01.971622 4306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:01.971689 4306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:01.971730 4306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:01.973227 4306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:01.973495 4306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:01.973722 4306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:01.978605 4314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:01.978626 4311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:01.978674 4312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:01.978814 4306 server_base.cc:1034] running on GCE node
I20260929 22:55:01.979033 4306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:01.979223 4306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:01.980381 4306 hybrid_clock.cc:648] HybridClock initialized: now 1790722501980365 us; error 27 us; skew 500 ppm
Sep 29 22:55:01 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:01.982870 4306 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:01.983340 4306 webserver.cc:460] Webserver started at http://127.0.124.130:41543/ using document root <none> and password file <none>
I20260929 22:55:01.983572 4306 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:01.983615 4306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:01.983767 4306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:01.984853 4306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "8e96db0dddd445e2bebcd5b65e24c4f1"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "5cb54442d9d3cccb2949e874f6060198"
server_key_iv: "f6105a7de298b7d2eee08c1acd67c5c9"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.985193 4306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "8e96db0dddd445e2bebcd5b65e24c4f1"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "5cb54442d9d3cccb2949e874f6060198"
server_key_iv: "f6105a7de298b7d2eee08c1acd67c5c9"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.986445 4306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:01.987128 4321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:01.987334 4306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:01.987432 4306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "8e96db0dddd445e2bebcd5b65e24c4f1"
format_stamp: "Formatted at 2026-09-29 22:55:01 on dist-test-slave-512q"
server_key: "5cb54442d9d3cccb2949e874f6060198"
server_key_iv: "f6105a7de298b7d2eee08c1acd67c5c9"
server_key_version: "encryptionkey@0"
I20260929 22:55:01.987500 4306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:02.019320 4306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:02.021857 4306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:02.022027 4306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:02.022262 4306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:02.022573 4306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:02.022606 4306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:02.022650 4306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:02.022675 4306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:02.028373 4306 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:42357
I20260929 22:55:02.028432 4435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:42357 every 8 connection(s)
I20260929 22:55:02.028725 4306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:02.032394 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4306
I20260929 22:55:02.032506 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:02.032673 498 external_mini_cluster.cc:1428] Setting key 769f6e68f3f9e6e10363c25edc2c2bb2
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:02.038471 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.029401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:33101 (local address 127.0.124.190:38371)
0929 22:55:02.029479 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:02.029482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:02.029674 (+ 192us) server_negotiation.cc:407] Connection header received
0929 22:55:02.030595 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:02.030596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:02.030607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:02.030658 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:02.031241 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.031735 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.033062 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.033260 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.033343 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.035631 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:02.035632 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:02.035633 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:02.035647 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:02.037069 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.037487 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.037489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.037489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.037552 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.037810 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.037811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.037811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.037928 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:02.038024 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:02.038290 (+ 266us) server_negotiation.cc:299] Negotiation successful
0929 22:55:02.038381 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:55:02.038715 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.029361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38371 (local address 127.0.124.130:33101)
0929 22:55:02.029554 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:02.029591 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:02.030504 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:02.030722 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:02.030725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:02.030966 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:02.031160 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:02.031163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.031812 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.031813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:02.032958 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:02.032961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.033351 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.033352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:02.033508 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.034049 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:02.034057 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:02.035524 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:02.037165 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:02.037172 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:02.037174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:02.037396 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:02.037620 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:02.037621 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:02.037621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:02.037736 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:02.038016 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:02.038022 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:02.038160 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 22:55:02.038269 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 22:55:02.038424 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260929 22:55:02.039167 4436 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38371
I20260929 22:55:02.039258 4436 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:02.039448 4436 heartbeater.cc:511] Master 127.0.124.190:38371 requested a full tablet report, sending...
I20260929 22:55:02.039829 4104 ts_manager.cc:194] Registered new tserver with Master: 8e96db0dddd445e2bebcd5b65e24c4f1 (127.0.124.130:42357)
I20260929 22:55:02.040275 4104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:33101
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:02.057289 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:02.138013 4441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:02.138232 4441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:02.138257 4441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:02.139533 4441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:02.139593 4441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:02.139649 4441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:02.141238 4441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:02.141534 4441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:02.141777 4441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:02.146826 4447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:02.146864 4449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:02.147009 4446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:02.147064 4441 server_base.cc:1034] running on GCE node
I20260929 22:55:02.147317 4441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:02.147562 4441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:02.148706 4441 hybrid_clock.cc:648] HybridClock initialized: now 1790722502148694 us; error 30 us; skew 500 ppm
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722502, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:02.151511 4441 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:02.152056 4441 webserver.cc:460] Webserver started at http://127.0.124.131:36669/ using document root <none> and password file <none>
I20260929 22:55:02.152351 4441 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:02.152402 4441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:02.152560 4441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:02.153663 4441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "44deefa71a8b47a1b4b8330ddabf063a"
format_stamp: "Formatted at 2026-09-29 22:55:02 on dist-test-slave-512q"
server_key: "4c04a77525ed90acb246a90fad774b64"
server_key_iv: "43d154d5a5f69c58bcc10f3a82dffc59"
server_key_version: "encryptionkey@0"
I20260929 22:55:02.154083 4441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "44deefa71a8b47a1b4b8330ddabf063a"
format_stamp: "Formatted at 2026-09-29 22:55:02 on dist-test-slave-512q"
server_key: "4c04a77525ed90acb246a90fad774b64"
server_key_iv: "43d154d5a5f69c58bcc10f3a82dffc59"
server_key_version: "encryptionkey@0"
I20260929 22:55:02.155412 4441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:02.156199 4456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:02.156461 4441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:02.156570 4441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "44deefa71a8b47a1b4b8330ddabf063a"
format_stamp: "Formatted at 2026-09-29 22:55:02 on dist-test-slave-512q"
server_key: "4c04a77525ed90acb246a90fad774b64"
server_key_iv: "43d154d5a5f69c58bcc10f3a82dffc59"
server_key_version: "encryptionkey@0"
I20260929 22:55:02.156658 4441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:02.170030 4441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:02.171996 4441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:02.172153 4441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:02.172401 4441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:02.172737 4441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:02.172794 4441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:02.172838 4441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:02.172870 4441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:02.179131 4441 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:33167
I20260929 22:55:02.179164 4572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:33167 every 8 connection(s)
I20260929 22:55:02.179575 4441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:02.181782 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4441
I20260929 22:55:02.181891 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:02.182078 498 external_mini_cluster.cc:1428] Setting key 662e8d5f0fc7ba86986c8325875d614e
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722502, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:02.189275 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.180311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:39979 (local address 127.0.124.190:38371)
0929 22:55:02.180351 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:02.180353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:02.180598 (+ 245us) server_negotiation.cc:407] Connection header received
0929 22:55:02.181662 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:02.181664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:02.181676 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:02.181739 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:02.182467 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.183062 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.184063 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.184334 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.184413 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.186472 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:02.186474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:02.186474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:02.186482 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:02.187846 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.188301 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.188302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.188303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.188368 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.188655 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.188656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.188656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.188773 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:02.188844 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:02.189112 (+ 268us) server_negotiation.cc:299] Negotiation successful
0929 22:55:02.189186 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:55:02.189483 4575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.180335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38371 (local address 127.0.124.131:39979)
0929 22:55:02.180464 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:02.180516 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:02.181525 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:02.181812 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:02.181815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:02.182123 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:02.182386 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:02.182392 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.183140 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.183141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:02.183964 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:02.183966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.184420 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.184421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:02.184557 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.185068 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:02.185077 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:02.186370 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:02.187977 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:02.187983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:02.187985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:02.188201 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:02.188482 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:02.188483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:02.188483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:02.188574 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:02.188848 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:02.188853 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:02.188987 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 22:55:02.189091 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 22:55:02.189241 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":65,"threads_started":1}
I20260929 22:55:02.189950 4573 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38371
I20260929 22:55:02.190068 4573 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:02.190267 4573 heartbeater.cc:511] Master 127.0.124.190:38371 requested a full tablet report, sending...
I20260929 22:55:02.190591 4104 ts_manager.cc:194] Registered new tserver with Master: 44deefa71a8b47a1b4b8330ddabf063a (127.0.124.131:33167)
I20260929 22:55:02.190915 4104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:39979
I20260929 22:55:02.193795 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:55:02.216161 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.208850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36204 (local address 127.0.124.129:44401)
0929 22:55:02.209004 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:02.209014 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:02.209024 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:02.209049 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:02.209051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:02.209064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:02.209130 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:02.209660 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.210382 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.211100 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.211512 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.211593 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.213726 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:02.213734 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:02.213734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:02.213740 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:02.215131 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.215491 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.215494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.215494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.215566 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.215714 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.215714 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.215714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.215825 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:02.215938 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:02.215990 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:55:02.216046 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:02.223652 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:02.217509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55496 (local address 127.0.124.190:38371)
0929 22:55:02.217577 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:02.217579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:02.217677 (+ 98us) server_negotiation.cc:407] Connection header received
0929 22:55:02.217725 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:02.217726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:02.217734 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:02.217774 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:02.218161 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.218661 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.219292 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:02.219490 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:02.219545 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:02.221685 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:02.221686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:02.221686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:02.221692 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:02.222812 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.223088 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.223088 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.223089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.223139 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:02.223274 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:02.223275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:02.223275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:02.223396 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:02.223463 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:02.223537 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:55:02.223592 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260929 22:55:02.224013 4104 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55496
I20260929 22:55:02.224377 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4170
I20260929 22:55:02.228893 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4306
I20260929 22:55:02.233291 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4441
I20260929 22:55:02.237304 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4069
2026-09-29T22:55:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1862 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4585](info): set up 2 sockets
Sep 29 22:55:02 dist-test-slave-512q krb5kdc[4585](info): commencing operation
krb5kdc: starting...
W20260929 22:55:03.262590 498 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:03.375170 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40897
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:03.453022 4598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:03.453226 4598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:03.453248 4598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:03.454314 4598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:03.454349 4598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:03.454365 4598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:03.454376 4598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:03.454388 4598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:03.455821 4598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:03.456017 4598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:03.456177 4598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:03.461027 4606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.461009 4603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.461004 4604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:03.461180 4598 server_base.cc:1034] running on GCE node
I20260929 22:55:03.461508 4598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:03.461776 4598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:03.462934 4598 hybrid_clock.cc:648] HybridClock initialized: now 1790722503462920 us; error 33 us; skew 500 ppm
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:03.465555 4598 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:03.465938 4598 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:03.465991 4598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:03.466084 4598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:03.467120 4598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "78251d129adb47bcaab55097f77f31a8"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "20b0b1ef6243e136ec916ef8757250d1"
server_key_iv: "71508b379e46ae845eb8c0acb631e04e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.467442 4598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "78251d129adb47bcaab55097f77f31a8"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "20b0b1ef6243e136ec916ef8757250d1"
server_key_iv: "71508b379e46ae845eb8c0acb631e04e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.468868 4598 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:03.469553 4612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.469727 4598 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:03.469849 4598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "78251d129adb47bcaab55097f77f31a8"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "20b0b1ef6243e136ec916ef8757250d1"
server_key_iv: "71508b379e46ae845eb8c0acb631e04e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.469949 4598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:03.498095 4598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:03.500039 4598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:03.500243 4598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:03.504473 4598 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:40897
I20260929 22:55:03.504509 4665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:40897 every 8 connection(s)
I20260929 22:55:03.504788 4598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:03.505602 4666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:03.507794 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: Bootstrap starting.
I20260929 22:55:03.508412 4666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:03.508687 4666 log.cc:824] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:03.509384 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: No bootstrap required, opened a new log
I20260929 22:55:03.509737 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4598
I20260929 22:55:03.509845 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:03.510015 498 external_mini_cluster.cc:1428] Setting key 0a9a9bc54869cb1cc6bb44d25f587afb
I20260929 22:55:03.511387 4666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } }
I20260929 22:55:03.511518 4666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:03.511541 4666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78251d129adb47bcaab55097f77f31a8, State: Initialized, Role: FOLLOWER
I20260929 22:55:03.511729 4666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } }
I20260929 22:55:03.511821 4666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:03.511854 4666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:03.511927 4666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:03.512639 4666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } }
I20260929 22:55:03.512728 4666 leader_election.cc:302] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78251d129adb47bcaab55097f77f31a8; no voters:
I20260929 22:55:03.512897 4666 leader_election.cc:288] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:03.512959 4671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:03.513105 4671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [term 1 LEADER]: Becoming Leader. State: Replica: 78251d129adb47bcaab55097f77f31a8, State: Running, Role: LEADER
I20260929 22:55:03.513182 4666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:03.513402 4671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } }
I20260929 22:55:03.514365 4673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78251d129adb47bcaab55097f77f31a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } } }
I20260929 22:55:03.514452 4673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:03.515002 4672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78251d129adb47bcaab55097f77f31a8. Latest consensus state: current_term: 1 leader_uuid: "78251d129adb47bcaab55097f77f31a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78251d129adb47bcaab55097f77f31a8" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40897 } } }
I20260929 22:55:03.515072 4672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8 [sys.catalog]: This master's current role is: LEADER
W20260929 22:55:03.515327 4686 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:55:03.515390 4686 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:55:03.515446 4685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:03.515656 4685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:03.517283 4685 catalog_manager.cc:1347] Generated new cluster ID: e7948d6c67d24aefaeb9f655d2301484
I20260929 22:55:03.517338 4685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:03.522912 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:03.510570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.0.124.190:40897)
0929 22:55:03.510757 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:03.510766 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:03.510808 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:55:03.511382 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:03.511392 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:03.511446 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:03.511612 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:03.512449 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.513817 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.514913 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.515595 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.515720 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:03.519055 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:03.519059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:03.519059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:03.519071 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:03.521115 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.521519 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.521522 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.521522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.521641 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.521902 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.521903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.521903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.522190 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:03.522357 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:03.522459 (+ 102us) server_negotiation.cc:299] Negotiation successful
0929 22:55:03.522704 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260929 22:55:03.527201 4685 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:03.527902 4685 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:03.537555 4685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: Generated new TSK 0
I20260929 22:55:03.537735 4685 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:55:03.565105 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:03.644647 4692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:03.644897 4692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:03.644943 4692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:03.646165 4692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:03.646232 4692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:03.646281 4692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:03.647802 4692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:03.648067 4692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:03.648365 4692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:03.653038 4700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.653049 4697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.653066 4698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:03.653282 4692 server_base.cc:1034] running on GCE node
I20260929 22:55:03.653610 4692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:03.653846 4692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:03.654980 4692 hybrid_clock.cc:648] HybridClock initialized: now 1790722503654961 us; error 36 us; skew 500 ppm
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:03.657512 4692 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:55:03.657859 4692 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:03.657938 4692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:03.658116 4692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:03.659164 4692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "55c7271b7fa644d58641970da58f74d5"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "3c6df69873d7295f54d8b4feb7e69898"
server_key_iv: "f85b49dccd6263fdd610a4b146d7987e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.659641 4692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "55c7271b7fa644d58641970da58f74d5"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "3c6df69873d7295f54d8b4feb7e69898"
server_key_iv: "f85b49dccd6263fdd610a4b146d7987e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.661064 4692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:03.661868 4706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.662078 4692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:03.662171 4692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "55c7271b7fa644d58641970da58f74d5"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "3c6df69873d7295f54d8b4feb7e69898"
server_key_iv: "f85b49dccd6263fdd610a4b146d7987e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.662253 4692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:03.681480 4692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:03.683326 4692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:03.683494 4692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:03.683732 4692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:03.684047 4692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:03.684098 4692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.684139 4692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:03.684163 4692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.689678 4692 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:33521
I20260929 22:55:03.689752 4821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:33521 every 8 connection(s)
I20260929 22:55:03.690035 4692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:03.698904 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:03.690785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:37205 (local address 127.0.124.190:40897)
0929 22:55:03.690861 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:03.690863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:03.691025 (+ 162us) server_negotiation.cc:407] Connection header received
0929 22:55:03.691536 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:03.691537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:03.691551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:03.691603 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:03.692535 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.693031 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.694029 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.694225 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.694279 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:03.696314 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:03.696316 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:03.696316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:03.696322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:03.697763 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.698113 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.698114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.698114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.698164 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.698378 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.698379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.698379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.698475 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:03.698552 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:03.698779 (+ 227us) server_negotiation.cc:299] Negotiation successful
0929 22:55:03.698842 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:55:03.699116 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:03.690742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40897 (local address 127.0.124.129:37205)
0929 22:55:03.690898 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:03.690938 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:03.691386 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:03.691655 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:03.691659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:03.691907 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:03.692458 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:03.692464 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.693110 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.693110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:03.693949 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:03.693951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.694300 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.694300 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:03.694439 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:03.694860 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:03.694868 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:03.696170 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:03.697835 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:03.697840 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:03.697842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:03.698049 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:03.698221 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:03.698222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:03.698222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:03.698324 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:03.698558 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:03.698562 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:03.698671 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 22:55:03.698752 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:55:03.698869 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":95,"threads_started":1}
I20260929 22:55:03.699674 4822 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40897
I20260929 22:55:03.699772 4822 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:03.699923 4822 heartbeater.cc:511] Master 127.0.124.190:40897 requested a full tablet report, sending...
I20260929 22:55:03.700168 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4692
I20260929 22:55:03.700311 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:03.700505 498 external_mini_cluster.cc:1428] Setting key 1647dcb259fd03757ef29ed49dccb2b2
I20260929 22:55:03.700512 4629 ts_manager.cc:194] Registered new tserver with Master: 55c7271b7fa644d58641970da58f74d5 (127.0.124.129:33521)
I20260929 22:55:03.701344 4629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:37205
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:03.725380 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:03.806025 4827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:03.806222 4827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:03.806245 4827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:03.807386 4827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:03.807426 4827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:03.807453 4827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:03.808959 4827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:03.809196 4827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:03.809422 4827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:03.814316 4836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.814318 4833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.814318 4832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:03.814713 4827 server_base.cc:1034] running on GCE node
I20260929 22:55:03.814953 4827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:03.815279 4827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:03.816454 4827 hybrid_clock.cc:648] HybridClock initialized: now 1790722503816441 us; error 27 us; skew 500 ppm
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:03.819805 4827 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:03.820282 4827 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:03.820353 4827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:03.820498 4827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:03.821751 4827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "6269de1e724b4085b97e8a448738e0f9"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "6949e5db66e32f02a17205cb3e5c7bdf"
server_key_iv: "fb3ec4e329f9e3cb9fa6823676734e6e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.822214 4827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "6269de1e724b4085b97e8a448738e0f9"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "6949e5db66e32f02a17205cb3e5c7bdf"
server_key_iv: "fb3ec4e329f9e3cb9fa6823676734e6e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.823927 4827 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260929 22:55:03.824852 4842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.825021 4827 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.825127 4827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "6269de1e724b4085b97e8a448738e0f9"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "6949e5db66e32f02a17205cb3e5c7bdf"
server_key_iv: "fb3ec4e329f9e3cb9fa6823676734e6e"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.825224 4827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:03.841179 4827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:03.842990 4827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:03.843146 4827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:03.843358 4827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:03.843657 4827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:03.843709 4827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.843750 4827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:03.843777 4827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.849534 4827 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:40517
I20260929 22:55:03.849577 4959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:40517 every 8 connection(s)
I20260929 22:55:03.849845 4827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:03.850075 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4827
I20260929 22:55:03.850209 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:03.850425 498 external_mini_cluster.cc:1428] Setting key 4363cff14cc905288b582fe1147651f5
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:03.859823 4962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:03.850550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40897 (local address 127.0.124.130:49205)
0929 22:55:03.850712 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:03.850761 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:03.851326 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:03.851569 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:03.851573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:03.851818 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:03.852442 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:03.852450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.853137 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.853139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:03.854005 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:03.854008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.854330 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.854331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:03.854483 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:03.854971 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:03.854987 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:03.856616 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:03.858519 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:03.858525 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:03.858526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:03.858734 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:03.858976 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:03.858976 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:03.858976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:03.859067 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:03.859361 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:03.859364 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:03.859478 (+ 114us) client_negotiation.cc:769] Sending connection context
0929 22:55:03.859557 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:55:03.859668 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260929 22:55:03.859834 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:03.850539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:49205 (local address 127.0.124.190:40897)
0929 22:55:03.850598 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:03.850601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:03.850829 (+ 228us) server_negotiation.cc:407] Connection header received
0929 22:55:03.851432 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:03.851433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:03.851445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:03.851518 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:03.852558 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.853046 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.854084 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:03.854258 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:03.854310 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:03.856705 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:03.856707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:03.856707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:03.856716 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:03.858426 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.858811 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.858812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.858813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.858877 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:03.859145 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:03.859147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:03.859147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:03.859290 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:03.859370 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:03.859609 (+ 239us) server_negotiation.cc:299] Negotiation successful
0929 22:55:03.859704 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:55:03.860347 4960 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40897
I20260929 22:55:03.860453 4960 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:03.860603 4960 heartbeater.cc:511] Master 127.0.124.190:40897 requested a full tablet report, sending...
I20260929 22:55:03.860967 4629 ts_manager.cc:194] Registered new tserver with Master: 6269de1e724b4085b97e8a448738e0f9 (127.0.124.130:40517)
I20260929 22:55:03.861423 4629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:49205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:03.879149 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:03.958209 4966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:03.958395 4966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:03.958417 4966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:03.959506 4966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:03.959546 4966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:03.959591 4966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:03.961112 4966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:03.961350 4966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:03.961586 4966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:03.966455 4971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:03.966466 4972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:03.966569 4966 server_base.cc:1034] running on GCE node
W20260929 22:55:03.966665 4974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:03.966933 4966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:03.967171 4966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:03.968281 4966 hybrid_clock.cc:648] HybridClock initialized: now 1790722503968264 us; error 44 us; skew 500 ppm
Sep 29 22:55:03 dist-test-slave-512q krb5kdc[4585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:03.970659 4966 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:03.971006 4966 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:03.971076 4966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:03.971212 4966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:03.972199 4966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "c99e7e6e45d143268cf62112abb6630c"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "571b23ac72c97a1923382e5d8c0a9e5f"
server_key_iv: "53321b18844ebb7f1d523e02cb66479a"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.972630 4966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "c99e7e6e45d143268cf62112abb6630c"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "571b23ac72c97a1923382e5d8c0a9e5f"
server_key_iv: "53321b18844ebb7f1d523e02cb66479a"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.973987 4966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:03.974651 4980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.974823 4966 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:03.974912 4966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "c99e7e6e45d143268cf62112abb6630c"
format_stamp: "Formatted at 2026-09-29 22:55:03 on dist-test-slave-512q"
server_key: "571b23ac72c97a1923382e5d8c0a9e5f"
server_key_iv: "53321b18844ebb7f1d523e02cb66479a"
server_key_version: "encryptionkey@0"
I20260929 22:55:03.974996 4966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:03.991071 4966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:03.992794 4966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:03.992950 4966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:03.993167 4966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:03.993463 4966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:03.993523 4966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.993558 4966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:03.993585 4966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:03.999289 4966 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:38945
I20260929 22:55:03.999332 5094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:38945 every 8 connection(s)
I20260929 22:55:03.999583 4966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:04.003750 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 4966
I20260929 22:55:04.003876 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:04.004078 498 external_mini_cluster.cc:1428] Setting key 7d31098658e3503309120477a620b475
Sep 29 22:55:04 dist-test-slave-512q krb5kdc[4585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:04.009413 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.000282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:58635 (local address 127.0.124.190:40897)
0929 22:55:04.000357 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.000360 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.000572 (+ 212us) server_negotiation.cc:407] Connection header received
0929 22:55:04.001004 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.001006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.001015 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.001065 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.002010 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.002486 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.003447 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.003658 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.003795 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.006353 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.006354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.006355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:04.006364 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.007720 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:04.008233 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:04.008235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:04.008236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:04.008332 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:04.008708 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:04.008709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:04.008709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:04.008842 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.008955 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.009229 (+ 274us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.009324 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:55:04.009588 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.000266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40897 (local address 127.0.124.131:58635)
0929 22:55:04.000437 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.000470 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.000924 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.001163 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.001167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.001462 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.001923 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.001929 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.002562 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.002563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.003340 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.003342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.003806 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.003807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.003997 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.004605 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:04.004617 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.006229 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.007836 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:04.007843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:04.007845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:04.008105 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:04.008454 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:04.008455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:04.008456 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:04.008629 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:04.008946 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.008952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.009090 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.009194 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.009347 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":109,"threads_started":1}
I20260929 22:55:04.010043 5095 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40897
I20260929 22:55:04.010129 5095 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:04.010233 5095 heartbeater.cc:511] Master 127.0.124.190:40897 requested a full tablet report, sending...
I20260929 22:55:04.010530 4629 ts_manager.cc:194] Registered new tserver with Master: c99e7e6e45d143268cf62112abb6630c (127.0.124.131:38945)
I20260929 22:55:04.010870 4629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:58635
I20260929 22:55:04.015969 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:55:04.022862 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.017325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.0.124.190:40897)
0929 22:55:04.017363 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.017365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.017470 (+ 105us) server_negotiation.cc:407] Connection header received
0929 22:55:04.017494 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.017494 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.017503 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.017549 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.018048 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.018502 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.019275 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.019451 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.019512 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.020696 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.020697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.020697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:04.020702 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.021832 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:04.022128 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:04.022129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:04.022129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:04.022177 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:04.022333 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:04.022333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:04.022333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:04.022468 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.022537 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.022624 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.022744 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:55:04.024477 4629 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:04.026006 4629 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:04.032193 5105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.028092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:40517 (local address 127.0.0.1:53072)
0929 22:55:04.028476 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.028485 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.028529 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.028688 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.028691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.028694 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:04.028767 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.028769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.029775 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.029776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.031210 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.031211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.031874 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.031958 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.031971 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.032047 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.032102 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":35,"threads_started":1}
I20260929 22:55:04.032343 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.027904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:38945 (local address 127.0.0.1:54410)
0929 22:55:04.028069 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.028105 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.028166 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.028812 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.028813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.028815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:04.028858 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.028859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.030076 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.030077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.031186 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.031188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.032017 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.032018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.032073 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.032076 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.032132 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.032164 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260929 22:55:04.032441 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.028296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53072 (local address 127.0.124.130:40517)
0929 22:55:04.028460 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.028464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.028522 (+ 58us) server_negotiation.cc:407] Connection header received
0929 22:55:04.028575 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.028577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.028589 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.028684 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:04.028853 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.029681 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031292 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.031772 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031875 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.031932 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.032283 (+ 351us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.032329 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260929 22:55:04.032666 5107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.028087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.0.124.131:38945)
0929 22:55:04.028651 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.028656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.028665 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:04.028703 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.028705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.028721 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.028806 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:04.028932 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.029978 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031263 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.031955 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.032018 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.032064 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.032146 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.032204 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":90,"threads_started":1}
I20260929 22:55:04.032825 5106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.028104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48816 (local address 127.0.124.129:33521)
0929 22:55:04.028943 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.028947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.028957 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:04.029003 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.029004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.029019 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.029087 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:04.029198 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.030212 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031145 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.031879 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.031951 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.032020 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.032472 (+ 452us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.032737 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":802,"thread_start_us":76,"threads_started":1}
I20260929 22:55:04.032924 5103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.027904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:33521 (local address 127.0.0.1:48816)
0929 22:55:04.028285 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.028294 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.028334 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.029103 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.029105 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.029107 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:04.029141 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.029143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.030312 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.030313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.031055 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.031057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.032056 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.032058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.032126 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.032130 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.032179 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.032246 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":3,"spinlock_wait_cycles":768,"thread_start_us":64,"threads_started":1}
I20260929 22:55:04.033181 4892 tablet_service.cc:1467] Processing CreateTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 (DEFAULT_TABLE table=test-table [id=b9c071135e30479fa20def43626aed80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.033309 5028 tablet_service.cc:1467] Processing CreateTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 (DEFAULT_TABLE table=test-table [id=b9c071135e30479fa20def43626aed80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.033547 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f78c3a08c74647f8bee8d5fa894e7cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.033674 5028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f78c3a08c74647f8bee8d5fa894e7cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.035971 5110 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Bootstrap starting.
I20260929 22:55:04.035974 5109 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Bootstrap starting.
I20260929 22:55:04.036702 5109 tablet_bootstrap.cc:654] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.036715 5110 tablet_bootstrap.cc:654] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.036713 4754 tablet_service.cc:1467] Processing CreateTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 (DEFAULT_TABLE table=test-table [id=b9c071135e30479fa20def43626aed80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.037040 4754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f78c3a08c74647f8bee8d5fa894e7cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.037289 5109 log.cc:824] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.037338 5110 log.cc:824] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.038040 5109 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: No bootstrap required, opened a new log
I20260929 22:55:04.038105 5109 ts_tablet_manager.cc:1397] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:55:04.039395 5109 raft_consensus.cc:348] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.039585 5109 raft_consensus.cc:374] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.039638 5109 raft_consensus.cc:729] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99e7e6e45d143268cf62112abb6630c, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.039625 5113 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: Bootstrap starting.
I20260929 22:55:04.039762 5109 consensus_queue.cc:260] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.040038 5110 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: No bootstrap required, opened a new log
I20260929 22:55:04.040055 5109 ts_tablet_manager.cc:1428] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:55:04.040117 5110 ts_tablet_manager.cc:1397] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260929 22:55:04.040189 5095 heartbeater.cc:503] Master 127.0.124.190:40897 was elected leader, sending a full tablet report...
I20260929 22:55:04.040321 5113 tablet_bootstrap.cc:654] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.040928 5113 log.cc:824] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.041617 5113 tablet_bootstrap.cc:492] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: No bootstrap required, opened a new log
I20260929 22:55:04.041668 5113 ts_tablet_manager.cc:1397] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:55:04.042006 5110 raft_consensus.cc:348] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.042165 5110 raft_consensus.cc:374] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.042209 5110 raft_consensus.cc:729] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6269de1e724b4085b97e8a448738e0f9, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.042326 5110 consensus_queue.cc:260] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.042593 4960 heartbeater.cc:503] Master 127.0.124.190:40897 was elected leader, sending a full tablet report...
I20260929 22:55:04.042593 5110 ts_tablet_manager.cc:1428] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260929 22:55:04.043632 5113 raft_consensus.cc:348] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.043745 5113 raft_consensus.cc:374] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.043766 5113 raft_consensus.cc:729] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c7271b7fa644d58641970da58f74d5, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.043890 5113 consensus_queue.cc:260] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.044164 4822 heartbeater.cc:503] Master 127.0.124.190:40897 was elected leader, sending a full tablet report...
I20260929 22:55:04.044175 5113 ts_tablet_manager.cc:1428] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 22:55:04.066453 5114 raft_consensus.cc:482] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:04.066555 5114 raft_consensus.cc:504] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.066958 5114 leader_election.cc:288] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c7271b7fa644d58641970da58f74d5 (127.0.124.129:33521), 6269de1e724b4085b97e8a448738e0f9 (127.0.124.130:40517)
I20260929 22:55:04.069717 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.067179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:42121 (local address 127.0.124.130:40517)
0929 22:55:04.067226 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.067229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.067238 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:04.067265 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.067266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.067275 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.067348 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:04.067496 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.067987 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.068988 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.069340 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.069452 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.069461 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.069623 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.069656 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:04.069717 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.067102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:40517 (local address 127.0.124.131:42121)
0929 22:55:04.067159 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.067171 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.067215 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.067353 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.067354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.067355 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:04.067428 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.067430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.068067 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.068068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.068869 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.068871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.069432 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.069433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.069542 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.069545 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.069615 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.069652 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 22:55:04.070010 4912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f78c3a08c74647f8bee8d5fa894e7cd0" candidate_uuid: "c99e7e6e45d143268cf62112abb6630c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6269de1e724b4085b97e8a448738e0f9" is_pre_election: true
I20260929 22:55:04.070200 4912 raft_consensus.cc:2454] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99e7e6e45d143268cf62112abb6630c in term 0.
I20260929 22:55:04.070242 5106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.067196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:58671 (local address 127.0.124.129:33521)
0929 22:55:04.067238 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.067240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.067452 (+ 212us) server_negotiation.cc:407] Connection header received
0929 22:55:04.067570 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.067573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.067585 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.067643 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:04.067803 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.068302 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.069234 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.069668 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.069728 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.069737 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.070129 (+ 392us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.070185 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:04.070250 5118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.067119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:33521 (local address 127.0.124.131:58671)
0929 22:55:04.067380 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.067388 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.067460 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.067646 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.067647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.067648 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:04.067723 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.067725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.068383 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.068384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.069151 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.069153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.069742 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.069743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.070024 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.070034 (+ 10us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.070099 (+ 65us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.070165 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":89,"thread_start_us":120,"threads_started":1}
I20260929 22:55:04.070444 4981 leader_election.cc:302] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6269de1e724b4085b97e8a448738e0f9, c99e7e6e45d143268cf62112abb6630c; no voters:
I20260929 22:55:04.070562 5114 raft_consensus.cc:2781] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:04.070605 5114 raft_consensus.cc:482] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:04.070559 4774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f78c3a08c74647f8bee8d5fa894e7cd0" candidate_uuid: "c99e7e6e45d143268cf62112abb6630c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7271b7fa644d58641970da58f74d5" is_pre_election: true
I20260929 22:55:04.070637 5114 raft_consensus.cc:3037] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.070686 4774 raft_consensus.cc:2454] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99e7e6e45d143268cf62112abb6630c in term 0.
I20260929 22:55:04.071333 5114 raft_consensus.cc:504] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.071468 5114 leader_election.cc:288] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [CANDIDATE]: Term 1 election: Requested vote from peers 55c7271b7fa644d58641970da58f74d5 (127.0.124.129:33521), 6269de1e724b4085b97e8a448738e0f9 (127.0.124.130:40517)
I20260929 22:55:04.071625 4912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f78c3a08c74647f8bee8d5fa894e7cd0" candidate_uuid: "c99e7e6e45d143268cf62112abb6630c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6269de1e724b4085b97e8a448738e0f9"
I20260929 22:55:04.071619 4774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f78c3a08c74647f8bee8d5fa894e7cd0" candidate_uuid: "c99e7e6e45d143268cf62112abb6630c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c7271b7fa644d58641970da58f74d5"
I20260929 22:55:04.071691 4912 raft_consensus.cc:3037] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.071689 4774 raft_consensus.cc:3037] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.072507 4912 raft_consensus.cc:2454] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99e7e6e45d143268cf62112abb6630c in term 1.
I20260929 22:55:04.072569 4774 raft_consensus.cc:2454] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99e7e6e45d143268cf62112abb6630c in term 1.
I20260929 22:55:04.072726 4981 leader_election.cc:302] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6269de1e724b4085b97e8a448738e0f9, c99e7e6e45d143268cf62112abb6630c; no voters:
I20260929 22:55:04.072822 5114 raft_consensus.cc:2781] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:04.072963 5114 raft_consensus.cc:686] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 1 LEADER]: Becoming Leader. State: Replica: c99e7e6e45d143268cf62112abb6630c, State: Running, Role: LEADER
I20260929 22:55:04.073063 5114 consensus_queue.cc:237] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } }
I20260929 22:55:04.073771 4629 catalog_manager.cc:5495] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c reported cstate change: term changed from 0 to 1, leader changed from <none> to c99e7e6e45d143268cf62112abb6630c (127.0.124.131). New cstate: current_term: 1 leader_uuid: "c99e7e6e45d143268cf62112abb6630c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99e7e6e45d143268cf62112abb6630c" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:04.083417 5107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.081324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54412 (local address 127.0.124.131:38945)
0929 22:55:04.081374 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.081376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.081384 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:04.081412 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.081413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.081435 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.081500 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:04.081611 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.082046 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.082741 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.082905 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.082954 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.083164 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:04.083247 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:04.083304 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.083356 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.083370 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:55:04.085175 4912 raft_consensus.cc:1261] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 1 FOLLOWER]: Refusing update from remote peer c99e7e6e45d143268cf62112abb6630c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:04.085196 4774 raft_consensus.cc:1261] T f78c3a08c74647f8bee8d5fa894e7cd0 P 55c7271b7fa644d58641970da58f74d5 [term 1 FOLLOWER]: Refusing update from remote peer c99e7e6e45d143268cf62112abb6630c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:04.085516 5119 consensus_queue.cc:1035] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6269de1e724b4085b97e8a448738e0f9" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:04.085618 5114 consensus_queue.cc:1035] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c7271b7fa644d58641970da58f74d5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 33521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:04.088442 5123 mvcc.cc:205] Tried to move back new op lower bound from 7334799376730632192 to 7334799376683859968. Current Snapshot: MvccSnapshot[applied={T|T < 7334799376730632192}]
I20260929 22:55:04.090464 4629 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:04.090559 4629 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:04.091295 4629 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 78251d129adb47bcaab55097f77f31a8: Sending DeleteTablet for 3 replicas of tablet f78c3a08c74647f8bee8d5fa894e7cd0
I20260929 22:55:04.091646 4754 tablet_service.cc:1514] Processing DeleteTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:48816
I20260929 22:55:04.091864 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4692
I20260929 22:55:04.091854 4892 tablet_service.cc:1514] Processing DeleteTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:53072
I20260929 22:55:04.092585 5133 tablet_replica.cc:330] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: stopping tablet replica
I20260929 22:55:04.092563 5028 tablet_service.cc:1514] Processing DeleteTablet for tablet f78c3a08c74647f8bee8d5fa894e7cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:54410
I20260929 22:55:04.092689 5133 raft_consensus.cc:2229] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:04.092784 5133 raft_consensus.cc:2258] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:04.093070 5134 tablet_replica.cc:330] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: stopping tablet replica
I20260929 22:55:04.093158 5134 raft_consensus.cc:2229] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:04.093257 5133 ts_tablet_manager.cc:1905] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:04.093271 5134 raft_consensus.cc:2258] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:04.094746 5133 ts_tablet_manager.cc:1918] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:04.094841 5133 log.cc:1196] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/f78c3a08c74647f8bee8d5fa894e7cd0
I20260929 22:55:04.095093 5133 ts_tablet_manager.cc:1939] T f78c3a08c74647f8bee8d5fa894e7cd0 P 6269de1e724b4085b97e8a448738e0f9: Deleting consensus metadata
I20260929 22:55:04.095541 4613 catalog_manager.cc:4841] TS 6269de1e724b4085b97e8a448738e0f9 (127.0.124.130:40517): tablet f78c3a08c74647f8bee8d5fa894e7cd0 (table test-table [id=b9c071135e30479fa20def43626aed80]) successfully deleted
I20260929 22:55:04.098718 5134 ts_tablet_manager.cc:1905] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:55:04.099581 4616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:33521 (error 108)
I20260929 22:55:04.099889 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4827
I20260929 22:55:04.100173 5134 ts_tablet_manager.cc:1918] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:04.100250 5134 log.cc:1196] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/f78c3a08c74647f8bee8d5fa894e7cd0
I20260929 22:55:04.100574 5134 ts_tablet_manager.cc:1939] T f78c3a08c74647f8bee8d5fa894e7cd0 P c99e7e6e45d143268cf62112abb6630c: Deleting consensus metadata
I20260929 22:55:04.100930 4613 catalog_manager.cc:4841] TS c99e7e6e45d143268cf62112abb6630c (127.0.124.131:38945): tablet f78c3a08c74647f8bee8d5fa894e7cd0 (table test-table [id=b9c071135e30479fa20def43626aed80]) successfully deleted
I20260929 22:55:04.104947 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4966
I20260929 22:55:04.105648 5103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.105095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:33521 (local address 127.0.0.1:48824)
0929 22:55:04.105567 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.105614 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449}
W20260929 22:55:04.106273 4616 catalog_manager.cc:4584] TS 55c7271b7fa644d58641970da58f74d5 (127.0.124.129:33521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f78c3a08c74647f8bee8d5fa894e7cd0: Network error: Client connection negotiation failed: client connection to 127.0.124.129:33521: connect: Connection refused (error 111)
I20260929 22:55:04.109755 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 4598
2026-09-29T22:55:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1872 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-29T22:55:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:04Z Disabled control of system clock
I20260929 22:55:04.136518 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:42975
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:44815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:42975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:55:04.215024 5139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:04.215207 5139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:04.215227 5139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:04.216336 5139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:04.216375 5139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:04.216388 5139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:04.216401 5139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:04.216413 5139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:04.217681 5139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:42975
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:42975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:04.217859 5139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:04.218068 5139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:04.222754 5144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.222797 5147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.223004 5145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.222983 5139 server_base.cc:1034] running on GCE node
I20260929 22:55:04.223227 5139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:04.223450 5139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:04.224612 5139 hybrid_clock.cc:648] HybridClock initialized: now 1790722504224606 us; error 37 us; skew 500 ppm
I20260929 22:55:04.225798 5139 webserver.cc:460] Webserver started at http://127.0.124.190:44725/ using document root <none> and password file <none>
I20260929 22:55:04.226045 5139 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:04.226115 5139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:04.226248 5139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:04.227263 5139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "ddec6a224d464cef9c89997ec8098c17"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "20907db71e77c8f7517ad46e005e5f0a"
server_key_iv: "221badff81aca46bb793dcf63f5766de"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.227626 5139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "ddec6a224d464cef9c89997ec8098c17"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "20907db71e77c8f7517ad46e005e5f0a"
server_key_iv: "221badff81aca46bb793dcf63f5766de"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.228986 5139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:04.229830 5153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.230018 5139 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:04.230127 5139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "ddec6a224d464cef9c89997ec8098c17"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "20907db71e77c8f7517ad46e005e5f0a"
server_key_iv: "221badff81aca46bb793dcf63f5766de"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.230201 5139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:04.233507 5139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:04.233769 5139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:04.233906 5139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:04.237607 5139 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:42975
I20260929 22:55:04.237634 5205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:42975 every 8 connection(s)
I20260929 22:55:04.237936 5139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:04.238561 5206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.240396 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5139
I20260929 22:55:04.240473 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:04.240641 498 external_mini_cluster.cc:1428] Setting key 0aba579d345de2dd7b50fe442a747520
I20260929 22:55:04.241703 5206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: Bootstrap starting.
I20260929 22:55:04.242370 5206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.242666 5206 log.cc:824] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.243312 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.241194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.0.124.190:42975)
0929 22:55:04.241395 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.241403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.241435 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:55:04.241954 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.241964 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.242025 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.242185 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.242874 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.242877 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.242877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.242882 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.242931 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.242941 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.243047 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.243107 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.243162 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260929 22:55:04.243404 5206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: No bootstrap required, opened a new log
I20260929 22:55:04.244899 5206 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } }
I20260929 22:55:04.245023 5206 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.245046 5206 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddec6a224d464cef9c89997ec8098c17, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.245188 5206 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } }
I20260929 22:55:04.245273 5206 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:04.245317 5206 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:04.245366 5206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.246120 5206 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } }
I20260929 22:55:04.246228 5206 leader_election.cc:302] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddec6a224d464cef9c89997ec8098c17; no voters:
I20260929 22:55:04.246371 5206 leader_election.cc:288] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:04.246392 5211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:04.246541 5211 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [term 1 LEADER]: Becoming Leader. State: Replica: ddec6a224d464cef9c89997ec8098c17, State: Running, Role: LEADER
I20260929 22:55:04.246639 5211 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } }
I20260929 22:55:04.246683 5206 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:04.247041 5213 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddec6a224d464cef9c89997ec8098c17. Latest consensus state: current_term: 1 leader_uuid: "ddec6a224d464cef9c89997ec8098c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } } }
I20260929 22:55:04.247031 5214 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddec6a224d464cef9c89997ec8098c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddec6a224d464cef9c89997ec8098c17" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 42975 } } }
I20260929 22:55:04.247149 5213 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:04.247182 5214 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:04.247363 5219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:04.248018 5219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:04.249675 5219 catalog_manager.cc:1347] Generated new cluster ID: 51ace4ab83314c63ad2ed1410073693f
I20260929 22:55:04.249728 5219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:04.265066 5219 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:04.265228 5219 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:04.275686 5219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: Generated new TSK 0
I20260929 22:55:04.275874 5219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:04.283387 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--builtin_ntp_servers=127.0.124.148:44815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:55:04.362869 5231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:04.363107 5231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:04.363145 5231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:04.364291 5231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:04.364353 5231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:04.364398 5231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:04.365741 5231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:04.366003 5231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:04.366278 5231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:04.372282 5238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.372289 5237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.372391 5231 server_base.cc:1034] running on GCE node
W20260929 22:55:04.372332 5240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.372714 5231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:04.372985 5231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:04.374138 5231 hybrid_clock.cc:648] HybridClock initialized: now 1790722504374114 us; error 39 us; skew 500 ppm
I20260929 22:55:04.375346 5231 webserver.cc:460] Webserver started at http://127.0.124.129:43929/ using document root <none> and password file <none>
I20260929 22:55:04.375586 5231 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:04.375630 5231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:04.375758 5231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:04.376844 5231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "09a87658667d43fbb8548c074678899d"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "96e09f83a8d0e110d1a261aa520b5c47"
server_key_iv: "36aae5ad24c05a96a9a8f9a48a040452"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.377197 5231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "09a87658667d43fbb8548c074678899d"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "96e09f83a8d0e110d1a261aa520b5c47"
server_key_iv: "36aae5ad24c05a96a9a8f9a48a040452"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.378504 5231 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:04.379185 5246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.379336 5231 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:04.379416 5231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "09a87658667d43fbb8548c074678899d"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "96e09f83a8d0e110d1a261aa520b5c47"
server_key_iv: "36aae5ad24c05a96a9a8f9a48a040452"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.379475 5231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:04.382714 5231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:04.382910 5231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:04.383095 5231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:04.383352 5231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:04.383687 5231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:04.383721 5231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.383744 5231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:04.383762 5231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.389712 5231 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:38751
I20260929 22:55:04.389761 5362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:38751 every 8 connection(s)
I20260929 22:55:04.390015 5231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:04.392972 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.390720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:46703 (local address 127.0.124.190:42975)
0929 22:55:04.390793 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.390796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.391001 (+ 205us) server_negotiation.cc:407] Connection header received
0929 22:55:04.391461 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.391462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.391467 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.391519 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.392746 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.392747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.392748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.392752 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.392765 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.392770 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.392819 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.392903 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.392915 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:55:04.393204 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.390676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:42975 (local address 127.0.124.129:46703)
0929 22:55:04.390859 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.390916 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.391368 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.391574 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.391577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.391585 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.392605 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.392605 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.392633 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.392667 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.392833 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.392837 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.392839 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.392909 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.392958 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
I20260929 22:55:04.393671 5363 heartbeater.cc:347] Connected to a master server at 127.0.124.190:42975
I20260929 22:55:04.393754 5363 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:04.393909 5363 heartbeater.cc:511] Master 127.0.124.190:42975 requested a full tablet report, sending...
I20260929 22:55:04.394369 5170 ts_manager.cc:194] Registered new tserver with Master: 09a87658667d43fbb8548c074678899d (127.0.124.129:38751)
I20260929 22:55:04.398409 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5231
I20260929 22:55:04.398551 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:04.398787 498 external_mini_cluster.cc:1428] Setting key bccab5a982facb3afb884b807821766d
I20260929 22:55:04.399818 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--builtin_ntp_servers=127.0.124.148:44815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:55:04.478454 5366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:04.478646 5366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:04.478667 5366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:04.479792 5366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:04.479830 5366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:04.479854 5366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:04.481189 5366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:04.481417 5366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:04.481688 5366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:04.486682 5371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.486769 5366 server_base.cc:1034] running on GCE node
W20260929 22:55:04.486670 5374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.486788 5372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.487028 5366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:04.487210 5366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:04.488339 5366 hybrid_clock.cc:648] HybridClock initialized: now 1790722504488321 us; error 35 us; skew 500 ppm
I20260929 22:55:04.489502 5366 webserver.cc:460] Webserver started at http://127.0.124.130:41229/ using document root <none> and password file <none>
I20260929 22:55:04.489722 5366 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:04.489766 5366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:04.489905 5366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:04.490916 5366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "ff704ea49be346609f942ed6fc1a5f75"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "179f8ba8e176a27768215b9f27b0d291"
server_key_iv: "9ab7adba7fbd5767006eaabcfd600c51"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.491253 5366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "ff704ea49be346609f942ed6fc1a5f75"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "179f8ba8e176a27768215b9f27b0d291"
server_key_iv: "9ab7adba7fbd5767006eaabcfd600c51"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.492488 5366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:04.493158 5381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.493327 5366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:04.493408 5366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "ff704ea49be346609f942ed6fc1a5f75"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "179f8ba8e176a27768215b9f27b0d291"
server_key_iv: "9ab7adba7fbd5767006eaabcfd600c51"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.493494 5366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:04.496721 5366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:04.496956 5366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:04.497087 5366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:04.497288 5366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:04.497566 5366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:04.497596 5366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.497644 5366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:04.497673 5366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.503027 5366 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:33039
I20260929 22:55:04.503073 5494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:33039 every 8 connection(s)
I20260929 22:55:04.503356 5366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:04.503984 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5366
I20260929 22:55:04.504102 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:04.504329 498 external_mini_cluster.cc:1428] Setting key 3db5a182cb5c885d420b71b50d9af8bb
I20260929 22:55:04.505275 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--builtin_ntp_servers=127.0.124.148:44815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260929 22:55:04.506428 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.504001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:56217 (local address 127.0.124.190:42975)
0929 22:55:04.504070 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.504073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.504270 (+ 197us) server_negotiation.cc:407] Connection header received
0929 22:55:04.504850 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.504851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.504868 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.504957 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.506173 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.506174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.506175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.506180 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.506196 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.506201 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.506267 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.506316 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.506330 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:04.506860 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.503954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:42975 (local address 127.0.124.130:56217)
0929 22:55:04.504142 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.504182 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.504755 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.505044 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.505048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.505058 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.506033 (+ 975us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.506034 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.506059 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.506087 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.506266 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.506268 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.506270 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.506320 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.506402 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260929 22:55:04.507371 5495 heartbeater.cc:347] Connected to a master server at 127.0.124.190:42975
I20260929 22:55:04.507465 5495 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:04.507612 5495 heartbeater.cc:511] Master 127.0.124.190:42975 requested a full tablet report, sending...
I20260929 22:55:04.507964 5170 ts_manager.cc:194] Registered new tserver with Master: ff704ea49be346609f942ed6fc1a5f75 (127.0.124.130:33039)
W20260929 22:55:04.583925 5498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:04.584115 5498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:04.584137 5498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:04.585265 5498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:04.585304 5498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:04.585330 5498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:04.586588 5498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:42975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:04.586757 5498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:04.586982 5498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:04.591813 5503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.591899 5504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.591993 5498 server_base.cc:1034] running on GCE node
W20260929 22:55:04.591856 5506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.592314 5498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:04.592590 5498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:04.593753 5498 hybrid_clock.cc:648] HybridClock initialized: now 1790722504593728 us; error 37 us; skew 500 ppm
I20260929 22:55:04.594937 5498 webserver.cc:460] Webserver started at http://127.0.124.131:42223/ using document root <none> and password file <none>
I20260929 22:55:04.595201 5498 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:04.595273 5498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:04.595408 5498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:04.596606 5498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "691929409d114a3c8150cdba8e39d1f1"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "058671f38f0817adeceb76ea53c0126a"
server_key_iv: "ed591b15a2608d075e5443f78f13086c"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.596951 5498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "691929409d114a3c8150cdba8e39d1f1"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "058671f38f0817adeceb76ea53c0126a"
server_key_iv: "ed591b15a2608d075e5443f78f13086c"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.598201 5498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:04.598891 5512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.599051 5498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:04.599153 5498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "691929409d114a3c8150cdba8e39d1f1"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "058671f38f0817adeceb76ea53c0126a"
server_key_iv: "ed591b15a2608d075e5443f78f13086c"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.599225 5498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:04.602562 5498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:04.602825 5498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:04.602968 5498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:04.603175 5498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:04.603473 5498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:04.603534 5498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.603572 5498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:04.603601 5498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.609299 5498 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35257
I20260929 22:55:04.609347 5626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35257 every 8 connection(s)
I20260929 22:55:04.609655 5498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:04.610296 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5498
I20260929 22:55:04.610404 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:04.610581 498 external_mini_cluster.cc:1428] Setting key 2fac5bd9a5223d87c6c15cc079ea3840
I20260929 22:55:04.612604 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.610387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44401 (local address 127.0.124.190:42975)
0929 22:55:04.610441 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.610445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.610676 (+ 231us) server_negotiation.cc:407] Connection header received
0929 22:55:04.611220 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.611220 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.611225 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.611261 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.612419 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.612420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.612420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.612423 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.612440 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.612444 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.612490 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.612545 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.612556 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:55:04.612792 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.610349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:42975 (local address 127.0.124.131:44401)
0929 22:55:04.610535 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.610573 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.611121 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.611346 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.611350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.611359 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.612268 (+ 909us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.612268 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.612304 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.612344 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.612496 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.612499 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.612501 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.612551 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.612596 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260929 22:55:04.613253 5627 heartbeater.cc:347] Connected to a master server at 127.0.124.190:42975
I20260929 22:55:04.613339 5627 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:04.613449 5627 heartbeater.cc:511] Master 127.0.124.190:42975 requested a full tablet report, sending...
I20260929 22:55:04.613775 5170 ts_manager.cc:194] Registered new tserver with Master: 691929409d114a3c8150cdba8e39d1f1 (127.0.124.131:35257)
I20260929 22:55:04.622201 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:55:04.624498 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.623465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.0.124.190:42975)
0929 22:55:04.623543 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.623545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.623601 (+ 56us) server_negotiation.cc:407] Connection header received
0929 22:55:04.623640 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.623641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.623645 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.623692 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.624204 (+ 512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.624259 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.624259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.624264 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.624284 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.624288 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.624333 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.624373 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.624383 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260929 22:55:04.625983 5170 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:04.627418 5170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:04.630949 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38751 (local address 127.0.0.1:35038)
0929 22:55:04.629593 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.629632 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.629685 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.630000 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.630005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.630012 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.630553 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.630554 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.630570 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.630593 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.630791 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.630796 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.630799 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.630868 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.630882 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":79,"threads_started":1}
I20260929 22:55:04.630973 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35038 (local address 127.0.124.129:38751)
0929 22:55:04.629824 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.629829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.629841 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:55:04.629868 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.629871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.629881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.630243 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.630666 (+ 423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.630671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.630672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.630675 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.630704 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.630719 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.630797 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.630877 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.630892 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260929 22:55:04.631693 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35257 (local address 127.0.0.1:39102)
0929 22:55:04.630018 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.630028 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.630096 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.630630 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.630631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.630634 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.631317 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.631317 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.631324 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.631338 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.631573 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.631574 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.631575 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.631627 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.631639 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
I20260929 22:55:04.631722 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39102 (local address 127.0.124.131:35257)
0929 22:55:04.629991 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.629995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.630177 (+ 182us) server_negotiation.cc:407] Connection header received
0929 22:55:04.630221 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.630223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.630232 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.630306 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.631424 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.631437 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.631437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.631442 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.631474 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.631498 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.631563 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.631633 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.631647 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260929 22:55:04.631961 5636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33039 (local address 127.0.0.1:39170)
0929 22:55:04.629877 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.629888 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.629947 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.630723 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.630724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.630727 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.631330 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.631331 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.631335 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.631342 (+ 7us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.631839 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.631840 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.631841 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.631894 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.631907 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":88,"threads_started":1}
I20260929 22:55:04.632027 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.629717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.0.124.130:33039)
0929 22:55:04.629869 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.629874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.629942 (+ 68us) server_negotiation.cc:407] Connection header received
0929 22:55:04.630039 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.630044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.630054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.630149 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.631438 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.631444 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.631445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.631449 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.631479 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.631509 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.631588 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.631921 (+ 333us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.631937 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260929 22:55:04.631902 5297 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e (DEFAULT_TABLE table=test-table [id=0e41991aa30d4f2db2c35a1b85514650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.632320 5297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d34aa0fc67c4dc383d604b715600c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.632455 5561 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e (DEFAULT_TABLE table=test-table [id=0e41991aa30d4f2db2c35a1b85514650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.632622 5429 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e (DEFAULT_TABLE table=test-table [id=0e41991aa30d4f2db2c35a1b85514650]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:04.632778 5561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d34aa0fc67c4dc383d604b715600c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.632912 5429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d34aa0fc67c4dc383d604b715600c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.635089 5641 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Bootstrap starting.
I20260929 22:55:04.635593 5641 tablet_bootstrap.cc:654] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.635851 5641 log.cc:824] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.635922 5643 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Bootstrap starting.
I20260929 22:55:04.636544 5643 tablet_bootstrap.cc:654] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.636633 5641 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: No bootstrap required, opened a new log
I20260929 22:55:04.636699 5641 ts_tablet_manager.cc:1397] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:04.636842 5643 log.cc:824] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.637181 5642 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Bootstrap starting.
I20260929 22:55:04.637594 5643 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: No bootstrap required, opened a new log
I20260929 22:55:04.637661 5643 ts_tablet_manager.cc:1397] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:04.638005 5642 tablet_bootstrap.cc:654] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.638298 5642 log.cc:824] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.639123 5642 tablet_bootstrap.cc:492] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: No bootstrap required, opened a new log
I20260929 22:55:04.639194 5642 ts_tablet_manager.cc:1397] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:04.639091 5641 raft_consensus.cc:348] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.639276 5641 raft_consensus.cc:374] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.639319 5641 raft_consensus.cc:729] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09a87658667d43fbb8548c074678899d, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.639436 5641 consensus_queue.cc:260] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.639696 5641 ts_tablet_manager.cc:1428] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:55:04.639822 5363 heartbeater.cc:503] Master 127.0.124.190:42975 was elected leader, sending a full tablet report...
I20260929 22:55:04.640297 5643 raft_consensus.cc:348] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.640458 5643 raft_consensus.cc:374] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 22:55:04.640472 5364 tablet.cc:2369] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:04.640492 5643 raft_consensus.cc:729] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691929409d114a3c8150cdba8e39d1f1, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.640609 5643 consensus_queue.cc:260] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.640846 5643 ts_tablet_manager.cc:1428] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 22:55:04.640955 5627 heartbeater.cc:503] Master 127.0.124.190:42975 was elected leader, sending a full tablet report...
I20260929 22:55:04.642004 5642 raft_consensus.cc:348] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.642115 5642 raft_consensus.cc:374] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.642135 5642 raft_consensus.cc:729] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff704ea49be346609f942ed6fc1a5f75, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.642236 5642 consensus_queue.cc:260] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.642443 5642 ts_tablet_manager.cc:1428] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:55:04.642504 5495 heartbeater.cc:503] Master 127.0.124.190:42975 was elected leader, sending a full tablet report...
I20260929 22:55:04.741953 5648 raft_consensus.cc:482] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:04.742093 5648 raft_consensus.cc:504] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.742496 5648 leader_election.cc:288] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691929409d114a3c8150cdba8e39d1f1 (127.0.124.131:35257), ff704ea49be346609f942ed6fc1a5f75 (127.0.124.130:33039)
I20260929 22:55:04.743824 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.742731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35257 (local address 127.0.124.129:57419)
0929 22:55:04.742801 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.742812 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.742853 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.743041 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.743042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.743045 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.743530 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.743530 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.743536 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.743546 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.743700 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.743700 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.743701 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.743744 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.743758 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 22:55:04.743824 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.742809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:57419 (local address 127.0.124.131:35257)
0929 22:55:04.742893 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.742895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.742904 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:04.742937 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.742938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.742943 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.743031 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.743629 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.743630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.743630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.743635 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.743649 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.743653 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.743705 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.743745 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.743758 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260929 22:55:04.744164 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.742731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:33039 (local address 127.0.124.129:47275)
0929 22:55:04.743027 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.743042 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.743105 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.743261 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.743262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.743265 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:04.743701 (+ 436us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:04.743702 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:04.743708 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:04.743719 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:04.744012 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:04.744013 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:04.744014 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:55:04.744080 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:55:04.744093 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":118,"thread_start_us":133,"threads_started":1}
I20260929 22:55:04.744169 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.742811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:47275 (local address 127.0.124.130:33039)
0929 22:55:04.742880 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.742882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.743101 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:55:04.743197 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.743199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.743205 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.743257 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.743803 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.743804 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.743805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.743809 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.743825 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.743829 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.743901 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.744085 (+ 184us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.744101 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:04.744176 5581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34aa0fc67c4dc383d604b715600c5e" candidate_uuid: "09a87658667d43fbb8548c074678899d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691929409d114a3c8150cdba8e39d1f1" is_pre_election: true
I20260929 22:55:04.744377 5581 raft_consensus.cc:2454] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09a87658667d43fbb8548c074678899d in term 0.
I20260929 22:55:04.744619 5248 leader_election.cc:302] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09a87658667d43fbb8548c074678899d, 691929409d114a3c8150cdba8e39d1f1; no voters:
I20260929 22:55:04.744686 5449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34aa0fc67c4dc383d604b715600c5e" candidate_uuid: "09a87658667d43fbb8548c074678899d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff704ea49be346609f942ed6fc1a5f75" is_pre_election: true
I20260929 22:55:04.744844 5449 raft_consensus.cc:2454] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09a87658667d43fbb8548c074678899d in term 0.
I20260929 22:55:04.744822 5648 raft_consensus.cc:2781] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:04.744885 5648 raft_consensus.cc:482] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:04.744910 5648 raft_consensus.cc:3037] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.745596 5648 raft_consensus.cc:504] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.745736 5648 leader_election.cc:288] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [CANDIDATE]: Term 1 election: Requested vote from peers 691929409d114a3c8150cdba8e39d1f1 (127.0.124.131:35257), ff704ea49be346609f942ed6fc1a5f75 (127.0.124.130:33039)
I20260929 22:55:04.745859 5449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34aa0fc67c4dc383d604b715600c5e" candidate_uuid: "09a87658667d43fbb8548c074678899d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff704ea49be346609f942ed6fc1a5f75"
I20260929 22:55:04.745868 5581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34aa0fc67c4dc383d604b715600c5e" candidate_uuid: "09a87658667d43fbb8548c074678899d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691929409d114a3c8150cdba8e39d1f1"
I20260929 22:55:04.745962 5581 raft_consensus.cc:3037] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.745965 5449 raft_consensus.cc:3037] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.746673 5581 raft_consensus.cc:2454] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09a87658667d43fbb8548c074678899d in term 1.
I20260929 22:55:04.746762 5449 raft_consensus.cc:2454] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09a87658667d43fbb8548c074678899d in term 1.
I20260929 22:55:04.746893 5248 leader_election.cc:302] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09a87658667d43fbb8548c074678899d, 691929409d114a3c8150cdba8e39d1f1; no voters:
I20260929 22:55:04.747087 5648 raft_consensus.cc:2781] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:04.747233 5648 raft_consensus.cc:686] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 1 LEADER]: Becoming Leader. State: Replica: 09a87658667d43fbb8548c074678899d, State: Running, Role: LEADER
I20260929 22:55:04.747324 5648 consensus_queue.cc:237] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } }
I20260929 22:55:04.748107 5170 catalog_manager.cc:5495] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d reported cstate change: term changed from 0 to 1, leader changed from <none> to 09a87658667d43fbb8548c074678899d (127.0.124.129). New cstate: current_term: 1 leader_uuid: "09a87658667d43fbb8548c074678899d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09a87658667d43fbb8548c074678899d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 } health_report { overall_health: UNKNOWN } } }
W20260929 22:55:04.753823 5496 tablet.cc:2369] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:04.776546 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.775385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.0.124.129:38751)
0929 22:55:04.775451 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.775453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.775462 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:04.775538 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.775539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.775553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.775621 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.776300 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.776302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.776302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.776307 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.776323 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.776327 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.776387 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.776456 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.776470 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:04.778219 5581 raft_consensus.cc:1261] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 1 FOLLOWER]: Refusing update from remote peer 09a87658667d43fbb8548c074678899d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:04.778264 5449 raft_consensus.cc:1261] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 1 FOLLOWER]: Refusing update from remote peer 09a87658667d43fbb8548c074678899d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:04.778605 5648 consensus_queue.cc:1035] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [LEADER]: Connected to new peer: Peer: permanent_uuid: "691929409d114a3c8150cdba8e39d1f1" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:04.778761 5652 consensus_queue.cc:1035] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff704ea49be346609f942ed6fc1a5f75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:04.781046 5655 mvcc.cc:205] Tried to move back new op lower bound from 7334799379569004544 to 7334799379445682176. Current Snapshot: MvccSnapshot[applied={T|T < 7334799379569004544}]
I20260929 22:55:04.781883 5656 mvcc.cc:205] Tried to move back new op lower bound from 7334799379569004544 to 7334799379445682176. Current Snapshot: MvccSnapshot[applied={T|T < 7334799379569004544}]
I20260929 22:55:04.783187 5170 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:04.783259 5170 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:04.783963 5170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddec6a224d464cef9c89997ec8098c17: Sending DeleteTablet for 3 replicas of tablet 5d34aa0fc67c4dc383d604b715600c5e
I20260929 22:55:04.784271 5297 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='slave'} at 127.0.0.1:35038
I20260929 22:55:04.784272 5561 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='slave'} at 127.0.0.1:39102
I20260929 22:55:04.784430 5429 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d34aa0fc67c4dc383d604b715600c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:04 UTC) from {username='slave'} at 127.0.0.1:39170
I20260929 22:55:04.784536 5666 tablet_replica.cc:330] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d: stopping tablet replica
I20260929 22:55:04.784626 5666 raft_consensus.cc:2229] T 5d34aa0fc67c4dc383d604b715600c5e P 09a87658667d43fbb8548c074678899d [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:04.784749 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5231
I20260929 22:55:04.785673 5665 tablet_replica.cc:330] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: stopping tablet replica
I20260929 22:55:04.785777 5665 raft_consensus.cc:2229] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:04.785887 5665 raft_consensus.cc:2258] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:04.786077 5667 tablet_replica.cc:330] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: stopping tablet replica
I20260929 22:55:04.786167 5667 raft_consensus.cc:2229] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:04.786269 5667 raft_consensus.cc:2258] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:04.786474 5665 ts_tablet_manager.cc:1905] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:04.786636 5667 ts_tablet_manager.cc:1905] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:04.787942 5665 ts_tablet_manager.cc:1918] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:04.788028 5665 log.cc:1196] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/5d34aa0fc67c4dc383d604b715600c5e
I20260929 22:55:04.788317 5665 ts_tablet_manager.cc:1939] T 5d34aa0fc67c4dc383d604b715600c5e P 691929409d114a3c8150cdba8e39d1f1: Deleting consensus metadata
I20260929 22:55:04.788594 5667 ts_tablet_manager.cc:1918] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:04.788655 5667 log.cc:1196] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/5d34aa0fc67c4dc383d604b715600c5e
I20260929 22:55:04.788888 5667 ts_tablet_manager.cc:1939] T 5d34aa0fc67c4dc383d604b715600c5e P ff704ea49be346609f942ed6fc1a5f75: Deleting consensus metadata
I20260929 22:55:04.789265 5156 catalog_manager.cc:4841] TS ff704ea49be346609f942ed6fc1a5f75 (127.0.124.130:33039): tablet 5d34aa0fc67c4dc383d604b715600c5e (table test-table [id=0e41991aa30d4f2db2c35a1b85514650]) successfully deleted
W20260929 22:55:04.790881 5154 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:38751 (error 108)
I20260929 22:55:04.791353 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.791231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38751 (local address 127.0.0.1:35052)
0929 22:55:04.791281 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.791320 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:55:04.791464 5154 catalog_manager.cc:4584] TS 09a87658667d43fbb8548c074678899d (127.0.124.129:38751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5d34aa0fc67c4dc383d604b715600c5e: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38751: connect: Connection refused (error 111)
I20260929 22:55:04.791970 5155 catalog_manager.cc:4841] TS 691929409d114a3c8150cdba8e39d1f1 (127.0.124.131:35257): tablet 5d34aa0fc67c4dc383d604b715600c5e (table test-table [id=0e41991aa30d4f2db2c35a1b85514650]) successfully deleted
I20260929 22:55:04.792158 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5366
I20260929 22:55:04.796792 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5498
I20260929 22:55:04.801553 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5139
2026-09-29T22:55:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (692 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260929 22:55:04.822270 498 mini_oidc.cc:152] Starting JWKS server
I20260929 22:55:04.823565 498 webserver.cc:460] Webserver started at https://127.0.0.1:46517/ using document root <none> and password file <none>
I20260929 22:55:04.823681 498 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:55:04.823865 498 webserver.cc:460] Webserver started at http://127.0.0.1:37437/ using document root <none> and password file <none>
2026-09-29T22:55:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:04Z Disabled control of system clock
I20260929 22:55:04.836141 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45877
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:40101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:45877
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46517/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/testchainca.cert with env {}
W20260929 22:55:04.915257 5674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:04.915478 5674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:04.915512 5674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:04.916668 5674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:04.916736 5674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:04.916757 5674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:04.916777 5674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:04.916807 5674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:55:04.916829 5674 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:55:04.916848 5674 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46517/jwks.json
I20260929 22:55:04.918306 5674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:45877
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46517/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:04.918581 5674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:04.918784 5674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:04.923452 5680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:04.923501 5679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.923698 5674 server_base.cc:1034] running on GCE node
W20260929 22:55:04.923768 5682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:04.924010 5674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:04.924285 5674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:04.925419 5674 hybrid_clock.cc:648] HybridClock initialized: now 1790722504925407 us; error 30 us; skew 500 ppm
I20260929 22:55:04.926440 5674 webserver.cc:460] Webserver started at http://127.0.124.190:44643/ using document root <none> and password file <none>
I20260929 22:55:04.926663 5674 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:04.926707 5674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:04.926860 5674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:04.927842 5674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "677bd48850294a77a0ec35bfda60dc2a"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "fe20bb5a3b59384d396a820f97cbf756"
server_key_iv: "c0c20450b015280e0b8c01de367e9a76"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.928197 5674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "677bd48850294a77a0ec35bfda60dc2a"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "fe20bb5a3b59384d396a820f97cbf756"
server_key_iv: "c0c20450b015280e0b8c01de367e9a76"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.929700 5674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:04.930498 5688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:04.930671 5674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:04.930765 5674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "677bd48850294a77a0ec35bfda60dc2a"
format_stamp: "Formatted at 2026-09-29 22:55:04 on dist-test-slave-512q"
server_key: "fe20bb5a3b59384d396a820f97cbf756"
server_key_iv: "c0c20450b015280e0b8c01de367e9a76"
server_key_version: "encryptionkey@0"
I20260929 22:55:04.930851 5674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:04.947075 5674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:04.947346 5674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:04.947490 5674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:04.951478 5674 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:45877
I20260929 22:55:04.951547 5740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:45877 every 8 connection(s)
I20260929 22:55:04.951879 5674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:04.952867 5741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:04.955006 5741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a: Bootstrap starting.
I20260929 22:55:04.955523 5741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:04.955751 5741 log.cc:824] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:04.956455 5741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a: No bootstrap required, opened a new log
I20260929 22:55:04.957906 5741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } }
I20260929 22:55:04.958030 5741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:04.958052 5741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677bd48850294a77a0ec35bfda60dc2a, State: Initialized, Role: FOLLOWER
I20260929 22:55:04.958181 5741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } }
I20260929 22:55:04.958256 5741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:04.958277 5741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:04.958303 5741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:04.958738 5741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } }
I20260929 22:55:04.958822 5741 leader_election.cc:302] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 677bd48850294a77a0ec35bfda60dc2a; no voters:
I20260929 22:55:04.958936 5741 leader_election.cc:288] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:04.959009 5744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:04.959164 5744 raft_consensus.cc:686] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [term 1 LEADER]: Becoming Leader. State: Replica: 677bd48850294a77a0ec35bfda60dc2a, State: Running, Role: LEADER
I20260929 22:55:04.959172 5741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:04.959276 5744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } }
I20260929 22:55:04.959622 5746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 677bd48850294a77a0ec35bfda60dc2a. Latest consensus state: current_term: 1 leader_uuid: "677bd48850294a77a0ec35bfda60dc2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } } }
I20260929 22:55:04.959704 5745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "677bd48850294a77a0ec35bfda60dc2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677bd48850294a77a0ec35bfda60dc2a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45877 } } }
I20260929 22:55:04.959717 5746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:04.959828 5745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:04.960299 5753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:04.960400 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5674
I20260929 22:55:04.960538 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:04.960718 498 external_mini_cluster.cc:1428] Setting key d40a9170117312671340a825bde1dd7c
I20260929 22:55:04.960801 5753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:04.962399 5753 catalog_manager.cc:1347] Generated new cluster ID: 9cb5437c95eb42399bc6e489d3c1af33
I20260929 22:55:04.962453 5753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:04.966068 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.961331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50046 (local address 127.0.124.190:45877)
0929 22:55:04.961585 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.961593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.961626 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:55:04.961742 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.961748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.961823 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.961988 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:04.962207 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.963193 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.963991 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.964549 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.964680 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.965409 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:04.965413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:04.965413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:04.965596 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:04.965626 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:04.965637 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:04.965708 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:04.965782 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:55:04.965859 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":68,"threads_started":1}
I20260929 22:55:04.966881 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:55:04.969326 5753 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:04.970006 5753 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:04.977522 5753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 677bd48850294a77a0ec35bfda60dc2a: Generated new TSK 0
I20260929 22:55:04.977675 5753 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 22:55:05.011917 5771 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260929 22:55:05.012018 5771 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260929 22:55:05.012259 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:04.989450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50062 (local address 127.0.124.190:45877)
0929 22:55:04.989501 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:04.989503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:04.989641 (+ 138us) server_negotiation.cc:407] Connection header received
0929 22:55:04.989743 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:04.989744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:04.989758 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:04.989828 (+ 70us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:55:04.990015 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.990501 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.991319 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.991509 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.991584 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.991788 (+ 204us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:55:05.011903 (+ 20115us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 22:55:05.012169 (+ 266us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50062: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:55:05.012327 5763 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50062: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260929 22:55:05.012617 5770 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:04.989382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45877 (local address 127.0.0.1:50062)
0929 22:55:04.989564 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:04.989574 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:04.989663 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:04.989849 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:04.989850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:04.989852 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:55:04.989928 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.989930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.990585 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.990586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.991215 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:04.991218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:04.991584 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:04.991585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:04.991647 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:04.991669 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:55:05.012179 (+ 20510us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 22:55:05.012323 (+ 144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.124.190:45877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.0.124.190:45877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46517/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260929 22:55:05.013121 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5674
2026-09-29T22:55:05Z chronyd exiting
I20260929 22:55:05.049068 498 test_util.cc:175] -----------------------------------------------
I20260929 22:55:05.049136 498 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790722483574547-498-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (228 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260929 22:55:05.049852 498 mini_oidc.cc:152] Starting JWKS server
I20260929 22:55:05.050547 498 webserver.cc:460] Webserver started at https://127.0.0.1:41971/ using document root <none> and password file <none>
I20260929 22:55:05.050617 498 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:55:05.050791 498 webserver.cc:460] Webserver started at http://127.0.0.1:36375/ using document root <none> and password file <none>
2026-09-29T22:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:05Z Disabled control of system clock
I20260929 22:55:05.058352 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:46437
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:37637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:46437
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41971/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/testchainca.cert with env {}
W20260929 22:55:05.134810 5777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:05.135037 5777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:05.135074 5777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:05.136252 5777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:05.136322 5777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:05.136343 5777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:05.136363 5777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:05.136389 5777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:55:05.136411 5777 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:55:05.136435 5777 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41971/jwks.json
I20260929 22:55:05.137812 5777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:46437
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:46437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41971/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:05.138100 5777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:05.138336 5777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:05.143067 5786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:05.143113 5784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:05.143095 5783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:05.143280 5777 server_base.cc:1034] running on GCE node
I20260929 22:55:05.143507 5777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:05.143769 5777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:05.144927 5777 hybrid_clock.cc:648] HybridClock initialized: now 1790722505144920 us; error 37 us; skew 500 ppm
I20260929 22:55:05.146001 5777 webserver.cc:460] Webserver started at http://127.0.124.190:38893/ using document root <none> and password file <none>
I20260929 22:55:05.146220 5777 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:05.146284 5777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:05.146409 5777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:05.147361 5777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "067cb0caa80e46a494a9d7026867d96f"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "9f532e6b3f67264f4179e87205d6edc1"
server_key_iv: "0b3eb389f469a9ce8d40c0dcc74cd1c2"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.147712 5777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "067cb0caa80e46a494a9d7026867d96f"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "9f532e6b3f67264f4179e87205d6edc1"
server_key_iv: "0b3eb389f469a9ce8d40c0dcc74cd1c2"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.149049 5777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:05.149685 5792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:05.149855 5777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:05.149950 5777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "067cb0caa80e46a494a9d7026867d96f"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "9f532e6b3f67264f4179e87205d6edc1"
server_key_iv: "0b3eb389f469a9ce8d40c0dcc74cd1c2"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.150029 5777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:05.179033 5777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:05.179342 5777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:05.179494 5777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:05.183378 5777 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:46437
I20260929 22:55:05.183414 5844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:46437 every 8 connection(s)
I20260929 22:55:05.183763 5777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:05.184731 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:05.186992 5845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f: Bootstrap starting.
I20260929 22:55:05.187500 5845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:05.187733 5845 log.cc:824] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:05.188354 5845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f: No bootstrap required, opened a new log
I20260929 22:55:05.189802 5845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } }
I20260929 22:55:05.189942 5845 raft_consensus.cc:374] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:05.189965 5845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 067cb0caa80e46a494a9d7026867d96f, State: Initialized, Role: FOLLOWER
I20260929 22:55:05.190062 5845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } }
I20260929 22:55:05.190126 5845 raft_consensus.cc:388] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:05.190147 5845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:05.190173 5845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:05.190621 5845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } }
I20260929 22:55:05.190701 5845 leader_election.cc:302] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 067cb0caa80e46a494a9d7026867d96f; no voters:
I20260929 22:55:05.190814 5845 leader_election.cc:288] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:05.190896 5848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:05.191072 5848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [term 1 LEADER]: Becoming Leader. State: Replica: 067cb0caa80e46a494a9d7026867d96f, State: Running, Role: LEADER
I20260929 22:55:05.191092 5845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:05.191170 5848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } }
I20260929 22:55:05.191535 5850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 067cb0caa80e46a494a9d7026867d96f. Latest consensus state: current_term: 1 leader_uuid: "067cb0caa80e46a494a9d7026867d96f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } } }
I20260929 22:55:05.191612 5849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "067cb0caa80e46a494a9d7026867d96f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067cb0caa80e46a494a9d7026867d96f" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46437 } } }
I20260929 22:55:05.191630 5850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.191669 5849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.191854 5857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:05.192399 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5777
I20260929 22:55:05.192497 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:05.192682 498 external_mini_cluster.cc:1428] Setting key b5790441154d0c656b53c2582ffcc7eb
I20260929 22:55:05.193055 5857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:05.194711 5857 catalog_manager.cc:1347] Generated new cluster ID: cb3639ae28ca450b98ce40b89fd2b748
I20260929 22:55:05.194761 5857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:05.199015 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.193276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.0.124.190:46437)
0929 22:55:05.193478 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.193494 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.193825 (+ 331us) server_negotiation.cc:407] Connection header received
0929 22:55:05.193975 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.193981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.194033 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.194158 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:05.194364 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.195748 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.196843 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.197394 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.197768 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.198200 (+ 432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:05.198204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:05.198204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:05.198414 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:05.198453 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:05.198465 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:05.198738 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:05.198765 (+ 27us) server_negotiation.cc:299] Negotiation successful
0929 22:55:05.198833 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260929 22:55:05.199934 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:55:05.206694 5857 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:05.207355 5857 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:05.212734 5857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 067cb0caa80e46a494a9d7026867d96f: Generated new TSK 0
I20260929 22:55:05.212913 5857 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 22:55:05.244293 5875 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260929 22:55:05.244378 5875 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260929 22:55:05.244907 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.222523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43644 (local address 127.0.124.190:46437)
0929 22:55:05.222589 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.222591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.222711 (+ 120us) server_negotiation.cc:407] Connection header received
0929 22:55:05.222807 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.222812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.222823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.222910 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:55:05.223058 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.223553 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.224399 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.224620 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.224704 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.224889 (+ 185us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:55:05.244630 (+ 19741us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 22:55:05.244819 (+ 189us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43644: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":42}
W20260929 22:55:05.244982 5866 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43644: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260929 22:55:05.245011 5874 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:05.222475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:46437 (local address 127.0.0.1:43644)
0929 22:55:05.222642 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:05.222650 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:05.222725 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:05.222908 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:05.222909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:05.222911 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:55:05.222970 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.222977 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.223647 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.223649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.224317 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.224319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.224707 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.224708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.224768 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.224773 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:55:05.244768 (+ 19995us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 22:55:05.244892 (+ 124us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.124.190:46437: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260929 22:55:05.245291 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5777
2026-09-29T22:55:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260929 22:55:05.282968 498 mini_oidc.cc:152] Starting JWKS server
I20260929 22:55:05.283653 498 webserver.cc:460] Webserver started at https://127.0.0.1:40447/ using document root <none> and password file <none>
I20260929 22:55:05.283695 498 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:55:05.283842 498 webserver.cc:460] Webserver started at http://127.0.0.1:36179/ using document root <none> and password file <none>
2026-09-29T22:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:05Z Disabled control of system clock
I20260929 22:55:05.291644 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:46479
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:46479
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40447/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 22:55:05.369232 5881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:05.369426 5881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:05.369447 5881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:05.370517 5881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:05.370550 5881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:05.370563 5881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:05.370575 5881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:05.370587 5881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:55:05.370599 5881 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:55:05.370610 5881 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40447/jwks.json
I20260929 22:55:05.371868 5881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:46479
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:46479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40447/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:05.372049 5881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:05.372282 5881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:05.377081 5887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:05.377089 5889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:05.377140 5881 server_base.cc:1034] running on GCE node
W20260929 22:55:05.377104 5886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:05.377545 5881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:05.377780 5881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:05.378912 5881 hybrid_clock.cc:648] HybridClock initialized: now 1790722505378904 us; error 30 us; skew 500 ppm
I20260929 22:55:05.380051 5881 webserver.cc:460] Webserver started at http://127.0.124.190:35307/ using document root <none> and password file <none>
I20260929 22:55:05.380340 5881 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:05.380406 5881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:05.380563 5881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:05.381579 5881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "fcf8d8a9213c4ef197ee22afde7279f0"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "71c56ae9d504a38ceb1808913b23996f"
server_key_iv: "94c7136a37de599e75a33920bdbb7fe4"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.381948 5881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "fcf8d8a9213c4ef197ee22afde7279f0"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "71c56ae9d504a38ceb1808913b23996f"
server_key_iv: "94c7136a37de599e75a33920bdbb7fe4"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.383312 5881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:05.384142 5895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:05.384482 5881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:05.384590 5881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "fcf8d8a9213c4ef197ee22afde7279f0"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "71c56ae9d504a38ceb1808913b23996f"
server_key_iv: "94c7136a37de599e75a33920bdbb7fe4"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.384680 5881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:05.398206 5881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:05.398471 5881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:05.398622 5881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:05.402390 5881 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:46479
I20260929 22:55:05.402419 5948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:46479 every 8 connection(s)
I20260929 22:55:05.402796 5881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:05.403398 5949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:05.405530 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5881
I20260929 22:55:05.405620 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:05.405784 498 external_mini_cluster.cc:1428] Setting key 5bef40c3ff2e89a6c13222bb1109b345
I20260929 22:55:05.406327 5949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0: Bootstrap starting.
I20260929 22:55:05.406910 5949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:05.407260 5949 log.cc:824] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:05.407961 5949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0: No bootstrap required, opened a new log
I20260929 22:55:05.410216 5949 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } }
I20260929 22:55:05.410382 5949 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:05.410409 5949 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcf8d8a9213c4ef197ee22afde7279f0, State: Initialized, Role: FOLLOWER
I20260929 22:55:05.410547 5949 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } }
I20260929 22:55:05.410622 5949 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:05.410681 5949 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:05.410723 5949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:05.411334 5949 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } }
I20260929 22:55:05.411456 5949 leader_election.cc:302] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcf8d8a9213c4ef197ee22afde7279f0; no voters:
I20260929 22:55:05.411535 5952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.406306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59684 (local address 127.0.124.190:46479)
0929 22:55:05.406529 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.406536 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.406559 (+ 23us) server_negotiation.cc:407] Connection header received
0929 22:55:05.406956 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.406962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.407048 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.407180 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:05.407419 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.408534 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.409593 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.409962 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.410055 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.410815 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:05.410819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:05.410819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:05.411004 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:05.411035 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:05.411046 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:05.411097 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:05.411200 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 22:55:05.411276 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260929 22:55:05.411620 5949 leader_election.cc:288] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:05.411777 5955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:05.411825 5949 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:05.411898 5955 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [term 1 LEADER]: Becoming Leader. State: Replica: fcf8d8a9213c4ef197ee22afde7279f0, State: Running, Role: LEADER
I20260929 22:55:05.411983 5955 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } }
I20260929 22:55:05.412341 5956 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcf8d8a9213c4ef197ee22afde7279f0. Latest consensus state: current_term: 1 leader_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } } }
I20260929 22:55:05.412434 5956 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.412357 5954 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf8d8a9213c4ef197ee22afde7279f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 46479 } } }
I20260929 22:55:05.412532 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:55:05.412575 5954 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.412731 5961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:05.413249 5961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:05.414892 5961 catalog_manager.cc:1347] Generated new cluster ID: 4ff0556db4674b0790c337180de16262
I20260929 22:55:05.414963 5961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:05.431056 5961 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:05.431705 5961 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:05.438894 5961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcf8d8a9213c4ef197ee22afde7279f0: Generated new TSK 0
I20260929 22:55:05.439064 5961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:05.449976 5952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.446644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59700 (local address 127.0.124.190:46479)
0929 22:55:05.446687 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.446689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.446774 (+ 85us) server_negotiation.cc:407] Connection header received
0929 22:55:05.446837 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.446838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.446846 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.446900 (+ 54us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:55:05.447028 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.447498 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.448625 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.448809 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.448858 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.449036 (+ 178us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:55:05.449751 (+ 715us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40447/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 22:55:05.449892 (+ 141us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59700: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40447/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":23}
W20260929 22:55:05.450034 5952 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59700: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40447/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260929 22:55:05.450033 5978 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:05.446569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:46479 (local address 127.0.0.1:59700)
0929 22:55:05.446702 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:05.446712 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:05.446777 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:05.446901 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:05.446902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:05.446904 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:55:05.446971 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.446973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.447573 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.447574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.448552 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.448555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.448880 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.448881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.448945 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.448950 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:55:05.449854 (+ 904us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40447/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 22:55:05.449941 (+ 87us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.124.190:46479: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40447/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260929 22:55:05.450202 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5881
E20260929 22:55:05.460533 5979 webserver.cc:533] Webserver: sslize failed:
E20260929 22:55:05.460590 5979 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-29T22:55:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (205 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-29T22:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:05Z Disabled control of system clock
I20260929 22:55:05.495088 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:37423
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:41961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:37423
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/testchainca.cert with env {}
W20260929 22:55:05.573254 5983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:05.573446 5983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:05.573465 5983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:05.574627 5983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:05.574667 5983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:05.574680 5983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:05.574692 5983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:05.574738 5983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:55:05.574754 5983 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:55:05.574780 5983 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260929 22:55:05.576309 5983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:37423
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:37423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:05.576543 5983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:05.576746 5983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:05.581375 5990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:05.581375 5988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:05.581471 5992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:05.581588 5983 server_base.cc:1034] running on GCE node
I20260929 22:55:05.581813 5983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:05.582033 5983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:05.583165 5983 hybrid_clock.cc:648] HybridClock initialized: now 1790722505583153 us; error 27 us; skew 500 ppm
I20260929 22:55:05.584331 5983 webserver.cc:460] Webserver started at http://127.0.124.190:36915/ using document root <none> and password file <none>
I20260929 22:55:05.584570 5983 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:05.584621 5983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:05.584771 5983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:05.585754 5983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "8e1661a9539646c583f2d2983f071003"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "308cac71637680372bc593b8a6ba8dde"
server_key_iv: "c852084abc9a68da95dd5bce7d738bba"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.586089 5983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "8e1661a9539646c583f2d2983f071003"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "308cac71637680372bc593b8a6ba8dde"
server_key_iv: "c852084abc9a68da95dd5bce7d738bba"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.587314 5983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:05.588018 5998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:05.588178 5983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:05.588302 5983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "8e1661a9539646c583f2d2983f071003"
format_stamp: "Formatted at 2026-09-29 22:55:05 on dist-test-slave-512q"
server_key: "308cac71637680372bc593b8a6ba8dde"
server_key_iv: "c852084abc9a68da95dd5bce7d738bba"
server_key_version: "encryptionkey@0"
I20260929 22:55:05.588374 5983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:05.598294 5983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:05.598564 5983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:05.598711 5983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:05.602253 5983 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:37423
I20260929 22:55:05.602312 6052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:37423 every 8 connection(s)
I20260929 22:55:05.602619 5983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:05.603514 6053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:05.605734 6053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003: Bootstrap starting.
I20260929 22:55:05.606282 6053 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:05.606581 6053 log.cc:824] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:05.607259 6053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003: No bootstrap required, opened a new log
I20260929 22:55:05.609009 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 5983
I20260929 22:55:05.609114 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:05.608989 6053 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } }
I20260929 22:55:05.609154 6053 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:05.609203 6053 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e1661a9539646c583f2d2983f071003, State: Initialized, Role: FOLLOWER
I20260929 22:55:05.609310 498 external_mini_cluster.cc:1428] Setting key 1aa6865b495caa1d01efb9928c90a7f4
I20260929 22:55:05.609351 6053 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } }
I20260929 22:55:05.609431 6053 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:05.609484 6053 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:05.609520 6053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:05.610127 6053 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } }
I20260929 22:55:05.610221 6053 leader_election.cc:302] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e1661a9539646c583f2d2983f071003; no voters:
I20260929 22:55:05.610386 6053 leader_election.cc:288] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:05.610409 6058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:05.610529 6058 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [term 1 LEADER]: Becoming Leader. State: Replica: 8e1661a9539646c583f2d2983f071003, State: Running, Role: LEADER
I20260929 22:55:05.610615 6058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } }
I20260929 22:55:05.610642 6053 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:05.611202 6061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e1661a9539646c583f2d2983f071003. Latest consensus state: current_term: 1 leader_uuid: "8e1661a9539646c583f2d2983f071003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } } }
I20260929 22:55:05.611295 6061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.611429 6060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e1661a9539646c583f2d2983f071003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1661a9539646c583f2d2983f071003" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 37423 } } }
I20260929 22:55:05.611478 6060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:05.611578 6068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:05.612043 6068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:05.614418 6068 catalog_manager.cc:1347] Generated new cluster ID: bddfc020ed7d433f989bd46f91f9ad36
I20260929 22:55:05.614470 6068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:05.615535 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.609742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54060 (local address 127.0.124.190:37423)
0929 22:55:05.609943 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.609951 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.609983 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:55:05.610083 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.610089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.610155 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.610296 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:05.610598 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.612667 (+ 2069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.613616 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.614097 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.614237 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.614891 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:05.614895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:05.614895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:05.615079 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:05.615116 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:05.615128 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:05.615160 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:05.615269 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 22:55:05.615337 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260929 22:55:05.616659 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:55:05.623764 6068 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:05.624449 6068 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:05.630167 6068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e1661a9539646c583f2d2983f071003: Generated new TSK 0
I20260929 22:55:05.630317 6068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:06.070402 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:05.636539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54076 (local address 127.0.124.190:37423)
0929 22:55:05.636597 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:05.636599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:05.636706 (+ 107us) server_negotiation.cc:407] Connection header received
0929 22:55:05.636770 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:05.636771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:05.636781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:05.636830 (+ 49us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:55:05.636949 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.637391 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.638530 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.638734 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.638806 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.638985 (+ 179us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:55:06.070179 (+431194us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 22:55:06.070341 (+ 162us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54076: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":36}
W20260929 22:55:06.070497 6057 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54076: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260929 22:55:06.070516 6084 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:05.636497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:37423 (local address 127.0.0.1:54076)
0929 22:55:05.636638 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:05.636648 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:05.636710 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:05.636839 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:05.636840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:05.636842 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:55:05.636899 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.636901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.637468 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.637469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.638444 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:05.638447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:05.638835 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:05.638836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:05.638895 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:05.638901 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:55:06.070316 (+431415us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 22:55:06.070438 (+ 122us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.124.190:37423: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":96,"threads_started":1}
I20260929 22:55:06.070909 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 5983
2026-09-29T22:55:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (601 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (87 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:06 dist-test-slave-512q krb5kdc[6096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:06 dist-test-slave-512q krb5kdc[6096](info): set up 2 sockets
Sep 29 22:55:06 dist-test-slave-512q krb5kdc[6096](info): commencing operation
krb5kdc: starting...
W20260929 22:55:07.278596 498 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:07.394992 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35009
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:35009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:07.475754 6109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:07.476007 6109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:07.476047 6109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:07.477280 6109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:07.477353 6109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:07.477380 6109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:07.477402 6109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:07.477455 6109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:07.478950 6109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:35009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:07.479238 6109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:07.479481 6109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:07.484318 6115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:07.484493 6109 server_base.cc:1034] running on GCE node
W20260929 22:55:07.484297 6114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.484594 6117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:07.484838 6109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:07.485065 6109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:07.486199 6109 hybrid_clock.cc:648] HybridClock initialized: now 1790722507486164 us; error 73 us; skew 500 ppm
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:07.492408 6109 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:07.492823 6109 webserver.cc:460] Webserver started at http://127.0.124.190:32907/ using document root <none> and password file <none>
I20260929 22:55:07.493052 6109 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:07.493096 6109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:07.493242 6109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:07.494278 6109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "c2d0ee50f5fa4239bfc7391698912ed3"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "e70100aba63deed20b63d640b4fa3893"
server_key_iv: "38cdc687c16cde3513d3c56f3b7ce507"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.494620 6109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "c2d0ee50f5fa4239bfc7391698912ed3"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "e70100aba63deed20b63d640b4fa3893"
server_key_iv: "38cdc687c16cde3513d3c56f3b7ce507"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.495940 6109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:07.496728 6124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.496920 6109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.497021 6109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "c2d0ee50f5fa4239bfc7391698912ed3"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "e70100aba63deed20b63d640b4fa3893"
server_key_iv: "38cdc687c16cde3513d3c56f3b7ce507"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.497089 6109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:07.514488 6109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:07.516453 6109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:07.516599 6109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:07.520154 6109 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:35009
I20260929 22:55:07.520238 6176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:35009 every 8 connection(s)
I20260929 22:55:07.520725 6109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:07.521337 6177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:07.523619 6177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3: Bootstrap starting.
I20260929 22:55:07.524133 6177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:07.524456 6177 log.cc:824] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:07.525059 6177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3: No bootstrap required, opened a new log
I20260929 22:55:07.526561 6177 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } }
I20260929 22:55:07.526706 6177 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:07.526729 6177 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d0ee50f5fa4239bfc7391698912ed3, State: Initialized, Role: FOLLOWER
I20260929 22:55:07.526860 6177 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } }
I20260929 22:55:07.526948 6177 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:07.526971 6177 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:07.527006 6177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:07.527822 6177 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } }
I20260929 22:55:07.527911 6177 leader_election.cc:302] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2d0ee50f5fa4239bfc7391698912ed3; no voters:
I20260929 22:55:07.528054 6177 leader_election.cc:288] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:07.528084 6180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:07.528225 6180 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [term 1 LEADER]: Becoming Leader. State: Replica: c2d0ee50f5fa4239bfc7391698912ed3, State: Running, Role: LEADER
I20260929 22:55:07.528324 6177 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:07.528365 6180 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } }
I20260929 22:55:07.528805 6182 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2d0ee50f5fa4239bfc7391698912ed3. Latest consensus state: current_term: 1 leader_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } } }
I20260929 22:55:07.528949 6182 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:07.528939 6181 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d0ee50f5fa4239bfc7391698912ed3" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35009 } } }
I20260929 22:55:07.529075 6181 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:07.529289 6189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:07.529618 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6109
I20260929 22:55:07.529717 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:07.529948 498 external_mini_cluster.cc:1428] Setting key cd2b2a818c17c4f82149fc6a9ed012b9
I20260929 22:55:07.530066 6189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:07.531617 6189 catalog_manager.cc:1347] Generated new cluster ID: c7c8cf7f50424fb7ab7aa0782c78bad8
I20260929 22:55:07.531668 6189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:07.541353 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:07.530473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53260 (local address 127.0.124.190:35009)
0929 22:55:07.530655 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:07.530665 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:07.530850 (+ 185us) server_negotiation.cc:407] Connection header received
0929 22:55:07.530959 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:07.530966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:07.531023 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:07.531159 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:07.531899 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.533322 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.534348 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.534968 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.535078 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:07.537866 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:07.537869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:07.537870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:07.537880 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:07.539722 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.540126 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.540129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.540129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.540249 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.540490 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.540490 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.540491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.540764 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:07.540916 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:07.541032 (+ 116us) server_negotiation.cc:299] Negotiation successful
0929 22:55:07.541148 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260929 22:55:07.544160 6189 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:07.544848 6189 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:07.552877 6189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2d0ee50f5fa4239bfc7391698912ed3: Generated new TSK 0
I20260929 22:55:07.553052 6189 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:55:07.585005 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:07.672960 6203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:07.673166 6203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:07.673190 6203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:07.674335 6203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:07.674387 6203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:07.674417 6203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:07.675783 6203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:07.675973 6203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:07.676149 6203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:07.681218 6211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.681335 6208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.681335 6209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:07.681417 6203 server_base.cc:1034] running on GCE node
I20260929 22:55:07.681694 6203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:07.681929 6203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:07.683092 6203 hybrid_clock.cc:648] HybridClock initialized: now 1790722507683090 us; error 35 us; skew 500 ppm
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:07.685842 6203 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:55:07.686379 6203 webserver.cc:460] Webserver started at http://127.0.124.129:43281/ using document root <none> and password file <none>
I20260929 22:55:07.686674 6203 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:07.686767 6203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:07.686916 6203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:07.688140 6203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "369a648435424a97bbafd1195d815816"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "593610c8e39330eaa6eb86a3a9b26241"
server_key_iv: "4755e746384fac4d43fa5aeb8df244ed"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.688593 6203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "369a648435424a97bbafd1195d815816"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "593610c8e39330eaa6eb86a3a9b26241"
server_key_iv: "4755e746384fac4d43fa5aeb8df244ed"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.690053 6203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:07.690828 6218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.691004 6203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:07.691099 6203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "369a648435424a97bbafd1195d815816"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "593610c8e39330eaa6eb86a3a9b26241"
server_key_iv: "4755e746384fac4d43fa5aeb8df244ed"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.691180 6203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:07.704620 6203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:07.706425 6203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:07.706588 6203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:07.706794 6203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:07.707089 6203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:07.707142 6203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.707180 6203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:07.707212 6203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.713274 6203 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:44727
I20260929 22:55:07.713372 6332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:44727 every 8 connection(s)
I20260929 22:55:07.713709 6203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:07.720184 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6203
I20260929 22:55:07.720337 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:07.720595 498 external_mini_cluster.cc:1428] Setting key 731c3ae2c9b91ac08cc1ac898398486b
I20260929 22:55:07.723111 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:07.714472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:34053 (local address 127.0.124.190:35009)
0929 22:55:07.714554 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:07.714557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:07.714723 (+ 166us) server_negotiation.cc:407] Connection header received
0929 22:55:07.715681 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:07.715682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:07.715694 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:07.715753 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:07.716426 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.716916 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.717943 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.718177 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.718263 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:07.720237 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:07.720239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:07.720239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:07.720248 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:07.721715 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.722098 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.722099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.722100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.722155 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.722426 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.722427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.722428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.722579 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:07.722650 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:07.722962 (+ 312us) server_negotiation.cc:299] Negotiation successful
0929 22:55:07.723049 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:07.723501 6335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:07.714445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35009 (local address 127.0.124.129:34053)
0929 22:55:07.714602 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:07.714646 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:07.715573 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:07.715816 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:07.715821 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:07.716076 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:07.716331 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:07.716336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.717025 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.717026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:07.717840 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:07.717842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.718272 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.718273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:07.718398 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:07.718844 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:07.718851 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:07.720120 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:07.721796 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:07.721802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:07.721804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:07.722015 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:07.722219 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:07.722220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:07.722221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:07.722337 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:07.722659 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:07.722665 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:07.722823 (+ 158us) client_negotiation.cc:769] Sending connection context
0929 22:55:07.722938 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:55:07.723128 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260929 22:55:07.723946 6333 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35009
I20260929 22:55:07.724032 6333 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:07.724259 6333 heartbeater.cc:511] Master 127.0.124.190:35009 requested a full tablet report, sending...
I20260929 22:55:07.724807 6140 ts_manager.cc:194] Registered new tserver with Master: 369a648435424a97bbafd1195d815816 (127.0.124.129:44727)
I20260929 22:55:07.725378 6140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:34053
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:07.744967 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:07.827150 6338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:07.827330 6338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:07.827353 6338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:07.828660 6338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:07.828709 6338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:07.828751 6338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:07.830341 6338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:07.830516 6338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:07.830673 6338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:07.835347 6343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.835386 6344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.835371 6346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:07.835603 6338 server_base.cc:1034] running on GCE node
I20260929 22:55:07.835829 6338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:07.836061 6338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:07.837215 6338 hybrid_clock.cc:648] HybridClock initialized: now 1790722507837175 us; error 51 us; skew 500 ppm
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:07.839633 6338 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:07.840073 6338 webserver.cc:460] Webserver started at http://127.0.124.130:36157/ using document root <none> and password file <none>
I20260929 22:55:07.840348 6338 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:07.840411 6338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:07.840552 6338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:07.841500 6338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "e01e6d5668b641628946d9ac5e547445"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "dc92513e64bec7a96e281a47e950369c"
server_key_iv: "95bb26fd491ed1ffaba3495dca2df25a"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.841853 6338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "e01e6d5668b641628946d9ac5e547445"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "dc92513e64bec7a96e281a47e950369c"
server_key_iv: "95bb26fd491ed1ffaba3495dca2df25a"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.843134 6338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:07.843788 6353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.843955 6338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:07.844055 6338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "e01e6d5668b641628946d9ac5e547445"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "dc92513e64bec7a96e281a47e950369c"
server_key_iv: "95bb26fd491ed1ffaba3495dca2df25a"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.844138 6338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:07.861299 6338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:07.863153 6338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:07.863315 6338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:07.863538 6338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:07.863834 6338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:07.863888 6338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.863929 6338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:07.863955 6338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.869624 6338 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:41895
I20260929 22:55:07.869668 6468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:41895 every 8 connection(s)
I20260929 22:55:07.869971 6338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:07.878697 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:07.870718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:54721 (local address 127.0.124.190:35009)
0929 22:55:07.870794 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:07.870797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:07.870973 (+ 176us) server_negotiation.cc:407] Connection header received
0929 22:55:07.871854 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:07.871856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:07.871866 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:07.871918 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:07.872566 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.873055 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.873995 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.874186 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.874254 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:07.876313 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:07.876314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:07.876315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:07.876320 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:07.877552 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.877911 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.877912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.877913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.877969 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:07.878183 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:07.878184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:07.878185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:07.878286 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:07.878339 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:07.878568 (+ 229us) server_negotiation.cc:299] Negotiation successful
0929 22:55:07.878633 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:55:07.878870 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:07.870668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35009 (local address 127.0.124.130:54721)
0929 22:55:07.870847 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:07.870881 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:07.871767 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:07.871978 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:07.871982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:07.872287 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:07.872495 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:07.872500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.873129 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.873129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:07.873894 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:07.873896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:07.874266 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:07.874267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:07.874358 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:07.874846 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:07.874853 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:07.876160 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:07.877631 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:07.877636 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:07.877638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:07.877846 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:07.878029 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:07.878029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:07.878030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:07.878120 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:07.878341 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:07.878344 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:07.878449 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 22:55:07.878538 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 22:55:07.878651 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260929 22:55:07.879379 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6338
I20260929 22:55:07.879434 6469 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35009
I20260929 22:55:07.879511 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:07.879522 6469 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:07.879705 498 external_mini_cluster.cc:1428] Setting key f6b87b144e94ed834402306dc37a1cb6
I20260929 22:55:07.879705 6469 heartbeater.cc:511] Master 127.0.124.190:35009 requested a full tablet report, sending...
I20260929 22:55:07.880153 6141 ts_manager.cc:194] Registered new tserver with Master: e01e6d5668b641628946d9ac5e547445 (127.0.124.130:41895)
I20260929 22:55:07.880577 6141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:54721
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:07.903165 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:07.982486 6474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:07.982726 6474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:07.982762 6474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:07.983893 6474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:07.983963 6474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:07.984007 6474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:07.985489 6474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:07.985780 6474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:07.986004 6474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:07.990832 6480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.990880 6479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:07.990830 6482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:07.990965 6474 server_base.cc:1034] running on GCE node
I20260929 22:55:07.991237 6474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:07.991427 6474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:07.992590 6474 hybrid_clock.cc:648] HybridClock initialized: now 1790722507992580 us; error 31 us; skew 500 ppm
Sep 29 22:55:07 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:07.995098 6474 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:07.995533 6474 webserver.cc:460] Webserver started at http://127.0.124.131:34321/ using document root <none> and password file <none>
I20260929 22:55:07.995710 6474 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:07.995747 6474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:07.995828 6474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:07.996903 6474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "9e132215989e423cb48d383893efc386"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "06bb445f865f35cb17cfc04c83fc1f5e"
server_key_iv: "02bd6eed8759b3e8d205ddd1392af10f"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.997200 6474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "9e132215989e423cb48d383893efc386"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "06bb445f865f35cb17cfc04c83fc1f5e"
server_key_iv: "02bd6eed8759b3e8d205ddd1392af10f"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.998404 6474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:07.999056 6489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:07.999241 6474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:07.999320 6474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "9e132215989e423cb48d383893efc386"
format_stamp: "Formatted at 2026-09-29 22:55:07 on dist-test-slave-512q"
server_key: "06bb445f865f35cb17cfc04c83fc1f5e"
server_key_iv: "02bd6eed8759b3e8d205ddd1392af10f"
server_key_version: "encryptionkey@0"
I20260929 22:55:07.999370 6474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:08.021668 6474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:08.023658 6474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:08.023766 6474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:08.023947 6474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:08.024315 6474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:08.024353 6474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:08.024374 6474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:08.024418 6474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:08.030447 6474 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:42637
I20260929 22:55:08.030489 6603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:42637 every 8 connection(s)
I20260929 22:55:08.030812 6474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:08.038044 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6474
I20260929 22:55:08.038113 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:08.038303 498 external_mini_cluster.cc:1428] Setting key 2c916e75ac751fe13de5ea66a9d63574
I20260929 22:55:08.039659 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:08.031410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:59897 (local address 127.0.124.190:35009)
0929 22:55:08.031478 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.031480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.031717 (+ 237us) server_negotiation.cc:407] Connection header received
0929 22:55:08.032706 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.032707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.032719 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.032784 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.033353 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.033838 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.034753 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.034970 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.035024 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:08.037045 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:08.037047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:08.037047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:08.037053 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:08.038258 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.038673 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.038674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.038674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.038749 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.039043 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.039044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.039044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.039204 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:08.039267 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:08.039536 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 22:55:08.039599 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:55:08.039810 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:08.031418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35009 (local address 127.0.124.131:59897)
0929 22:55:08.031601 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:08.031635 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:08.032610 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:08.032833 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:08.032837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:08.033103 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:08.033285 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:08.033289 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.033911 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.033912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:08.034682 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:08.034684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.035042 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.035043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:08.035139 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:08.035574 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:08.035581 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:08.036961 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:08.038327 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:08.038332 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:08.038335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:08.038585 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:08.038815 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:08.038816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:08.038816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:08.038969 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:08.039274 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:08.039280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:08.039418 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 22:55:08.039503 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:55:08.039618 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260929 22:55:08.040249 6604 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35009
I20260929 22:55:08.040357 6604 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:08.040529 6604 heartbeater.cc:511] Master 127.0.124.190:35009 requested a full tablet report, sending...
I20260929 22:55:08.040884 6141 ts_manager.cc:194] Registered new tserver with Master: 9e132215989e423cb48d383893efc386 (127.0.124.131:42637)
I20260929 22:55:08.041205 6141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:59897
I20260929 22:55:08.050283 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/test-admin.keytab.
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.065151 498 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260929 22:55:08.066881 6611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:08.066013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50488 (local address 127.0.124.129:44727)
0929 22:55:08.066186 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.066191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.066201 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:08.066225 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.066227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.066240 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.066303 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.066774 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50488: BlockingRecv error: recv got EOF from 127.0.0.1:50488 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
W20260929 22:55:08.066969 498 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc' of type FILE
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.067915 498 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.068794 498 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:55:08.076102 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:08.069262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.0.124.129:44727)
0929 22:55:08.069313 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.069314 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.069343 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:55:08.069394 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.069395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.069403 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.069449 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.069830 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.070544 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.071211 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.071523 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.071575 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:08.073572 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:08.073579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:08.073579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:08.073585 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:08.075141 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.075428 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.075431 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.075431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.075480 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.075622 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.075622 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.075622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.075726 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:08.075820 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:08.075874 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:55:08.075930 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 22:55:08.077765 6611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:08.077261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.0.124.129:44727)
0929 22:55:08.077334 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.077336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.077375 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:55:08.077420 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.077421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.077427 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.077470 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.077722 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50504: BlockingRecv error: recv got EOF from 127.0.0.1:50504 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260929 22:55:08.077844 498 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc' of type FILE
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.078677 498 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.079432 498 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:55:08.085523 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:08.079862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.0.124.129:44727)
0929 22:55:08.079915 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.079917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.079959 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:55:08.079994 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.079995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.080001 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.080043 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.080430 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.080867 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.081498 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.081682 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.081733 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:08.083522 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:08.083524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:08.083524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:08.083529 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:08.084656 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.084929 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.084930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.084930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.084974 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.085129 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.085130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.085130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.085196 (+ 66us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:08.085254 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:08.085333 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:55:08.085384 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260929 22:55:08.086874 6611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:08.086448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.0.124.129:44727)
0929 22:55:08.086485 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.086487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.086519 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:55:08.086561 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.086561 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.086568 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.086612 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.086829 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50522: BlockingRecv error: recv got EOF from 127.0.0.1:50522 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260929 22:55:08.087016 498 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790722483574547-498-0/krb5kdc/krb5cc' of type FILE
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.087872 498 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:08.088723 498 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:55:08.094978 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:08.089125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.0.124.129:44727)
0929 22:55:08.089155 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:08.089158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:08.089209 (+ 51us) server_negotiation.cc:407] Connection header received
0929 22:55:08.089251 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:08.089252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:08.089257 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:08.089303 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:08.089656 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.090075 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.090716 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:08.090881 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:08.090928 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:08.092844 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:08.092845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:08.092845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:08.092851 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:08.094097 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.094393 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.094394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.094394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.094442 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:08.094615 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:08.094615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:08.094615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:08.094720 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:08.094794 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:08.094877 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 22:55:08.094925 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260929 22:55:08.095646 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6203
I20260929 22:55:08.100037 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6338
I20260929 22:55:08.105288 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6474
I20260929 22:55:08.109223 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6109
2026-09-29T22:55:08Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1863 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6624](info): set up 2 sockets
Sep 29 22:55:08 dist-test-slave-512q krb5kdc[6624](info): commencing operation
krb5kdc: starting...
W20260929 22:55:09.200536 498 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab.
Entry for principal oryx/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab.
I20260929 22:55:09.326500 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40095
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab
--principal=oryx/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:09.407546 6637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:09.407752 6637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:09.407774 6637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:09.408882 6637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:09.408922 6637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:09.408937 6637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:09.408949 6637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:09.408962 6637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:09.410336 6637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab
--principal=oryx/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:09.410575 6637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:09.410789 6637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:09.415755 6642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.415755 6643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:09.416014 6637 server_base.cc:1034] running on GCE node
W20260929 22:55:09.415750 6645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:09.416337 6637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:09.416656 6637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:09.417845 6637 hybrid_clock.cc:648] HybridClock initialized: now 1790722509417838 us; error 51 us; skew 500 ppm
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:09.420380 6637 init.cc:377] Logged in from keytab as oryx/127.0.124.190@KRBTEST.COM (short username oryx)
I20260929 22:55:09.420892 6637 webserver.cc:460] Webserver started at http://127.0.124.190:46113/ using document root <none> and password file <none>
I20260929 22:55:09.421118 6637 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:09.421185 6637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:09.421339 6637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:09.422389 6637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "356f9818428a4b799a41e354aa6841ad"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "dfacfa7cf86085c974fc0b4a17afdeaf"
server_key_iv: "54b20b9894374007d4651411c8fe0682"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.422756 6637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "356f9818428a4b799a41e354aa6841ad"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "dfacfa7cf86085c974fc0b4a17afdeaf"
server_key_iv: "54b20b9894374007d4651411c8fe0682"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.424131 6637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:09.425012 6652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.425184 6637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:09.425282 6637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "356f9818428a4b799a41e354aa6841ad"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "dfacfa7cf86085c974fc0b4a17afdeaf"
server_key_iv: "54b20b9894374007d4651411c8fe0682"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.425370 6637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:09.445323 6637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:09.447240 6637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:09.447422 6637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:09.451674 6637 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:40095
I20260929 22:55:09.451723 6704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:40095 every 8 connection(s)
I20260929 22:55:09.452093 6637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:09.453052 6705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:09.455276 6705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Bootstrap starting.
I20260929 22:55:09.455829 6705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:09.456133 6705 log.cc:824] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:09.456822 6705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: No bootstrap required, opened a new log
I20260929 22:55:09.458410 6705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } }
I20260929 22:55:09.458549 6705 raft_consensus.cc:374] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:09.458571 6705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356f9818428a4b799a41e354aa6841ad, State: Initialized, Role: FOLLOWER
I20260929 22:55:09.458743 6705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } }
I20260929 22:55:09.458804 6705 raft_consensus.cc:388] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:09.458825 6705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:09.458878 6705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:09.459664 6705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } }
I20260929 22:55:09.459775 6705 leader_election.cc:302] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 356f9818428a4b799a41e354aa6841ad; no voters:
I20260929 22:55:09.459950 6705 leader_election.cc:288] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:09.460003 6708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:09.460152 6708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 LEADER]: Becoming Leader. State: Replica: 356f9818428a4b799a41e354aa6841ad, State: Running, Role: LEADER
I20260929 22:55:09.460240 6705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:09.460289 6708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } }
I20260929 22:55:09.460635 6709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } }
I20260929 22:55:09.460628 6710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 356f9818428a4b799a41e354aa6841ad. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } }
I20260929 22:55:09.460722 6709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:09.460728 6710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:09.460934 6716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:09.461359 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6637
I20260929 22:55:09.461459 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:09.461508 6716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:09.461898 498 external_mini_cluster.cc:1428] Setting key f586d056d24aafe35ed621603d85f485
I20260929 22:55:09.463182 6716 catalog_manager.cc:1347] Generated new cluster ID: 82646f2b675a4d3999ef5ccec68a57ff
I20260929 22:55:09.463232 6716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:09.472035 6716 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:09.472795 6716 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:09.473910 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.462689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.0.124.190:40095)
0929 22:55:09.462832 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:09.462841 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:09.462875 (+ 34us) server_negotiation.cc:407] Connection header received
0929 22:55:09.462990 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:09.462999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:09.463055 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:09.463195 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:09.464059 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.465499 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.466592 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.467230 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.467331 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.470151 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:09.470155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:09.470155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:09.470168 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:09.472187 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.472610 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.472614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.472614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.472718 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.472970 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.472971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.472971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.473268 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:09.473420 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:09.473526 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:55:09.473676 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":76,"threads_started":1}
I20260929 22:55:09.475587 6716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Generated new TSK 0
I20260929 22:55:09.475745 6716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
I20260929 22:55:09.503203 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:09.582433 6732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:09.582680 6732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:09.582719 6732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:09.583839 6732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:09.583913 6732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:09.583961 6732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:09.585408 6732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:09.585657 6732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:09.585892 6732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:09.590766 6737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.590756 6741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.590757 6739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:09.591154 6732 server_base.cc:1034] running on GCE node
I20260929 22:55:09.591504 6732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:09.591746 6732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:09.592937 6732 hybrid_clock.cc:648] HybridClock initialized: now 1790722509592912 us; error 34 us; skew 500 ppm
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:09.595661 6732 init.cc:377] Logged in from keytab as oryx/127.0.124.129@KRBTEST.COM (short username oryx)
I20260929 22:55:09.596149 6732 webserver.cc:460] Webserver started at http://127.0.124.129:38417/ using document root <none> and password file <none>
I20260929 22:55:09.596421 6732 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:09.596472 6732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:09.596575 6732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:09.597628 6732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "27e2925b69964ad99ac5b3800905c319"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "cc436b7a7f631eb13b4ff711c2ac3601"
server_key_iv: "986ac0e7be93143714b4610e89cd479e"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.597951 6732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "27e2925b69964ad99ac5b3800905c319"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "cc436b7a7f631eb13b4ff711c2ac3601"
server_key_iv: "986ac0e7be93143714b4610e89cd479e"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.599272 6732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:09.600014 6748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.600178 6732 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:09.600289 6732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "27e2925b69964ad99ac5b3800905c319"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "cc436b7a7f631eb13b4ff711c2ac3601"
server_key_iv: "986ac0e7be93143714b4610e89cd479e"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.600345 6732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:09.614684 6732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:09.616966 6732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:09.617069 6732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:09.617233 6732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:09.617520 6732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:09.617551 6732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.617600 6732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:09.617627 6732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.622997 6732 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:36595
I20260929 22:55:09.623080 6863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:36595 every 8 connection(s)
I20260929 22:55:09.623369 6732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:09.628093 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6732
I20260929 22:55:09.628248 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:09.628432 498 external_mini_cluster.cc:1428] Setting key e66941505549349b1165dd3be8861c2b
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:09.633148 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.624053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:50911 (local address 127.0.124.190:40095)
0929 22:55:09.624127 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:09.624130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:09.624337 (+ 207us) server_negotiation.cc:407] Connection header received
0929 22:55:09.624834 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:09.624835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:09.624845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:09.624900 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:09.625844 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.626324 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.627284 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.627475 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.627532 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.630183 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:09.630185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:09.630185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:09.630194 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:09.631608 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.632123 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.632123 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.632124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.632171 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.632473 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.632474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.632474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.632579 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:09.632634 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:09.633005 (+ 371us) server_negotiation.cc:299] Negotiation successful
0929 22:55:09.633082 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:55:09.633464 6866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.624006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:50911)
0929 22:55:09.624164 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:09.624197 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:09.624744 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:09.624992 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:09.624997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:09.625589 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:09.625770 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.625775 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.626398 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.626398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.627199 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.627201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.627585 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.627586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.627699 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.628279 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:09.628288 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:09.630072 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:09.631689 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.631696 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.631698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.632045 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.632261 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.632262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.632262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.632404 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.632651 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:09.632658 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:09.632823 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 22:55:09.632971 (+ 148us) client_negotiation.cc:240] Negotiation successful
0929 22:55:09.633219 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260929 22:55:09.634030 6864 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:09.634138 6864 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:09.634341 6864 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
I20260929 22:55:09.634819 6669 ts_manager.cc:194] Registered new tserver with Master: 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:09.635402 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:50911
WARNING: no policy specified for oryx/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
I20260929 22:55:09.654537 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:09.734445 6869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:09.734629 6869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:09.734651 6869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:09.735764 6869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:09.735805 6869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:09.735829 6869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:09.737246 6869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:09.737481 6869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:09.737707 6869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:09.742484 6874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.742499 6877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.742561 6875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:09.742760 6869 server_base.cc:1034] running on GCE node
I20260929 22:55:09.742978 6869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:09.743218 6869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:09.744381 6869 hybrid_clock.cc:648] HybridClock initialized: now 1790722509744358 us; error 36 us; skew 500 ppm
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:09.747027 6869 init.cc:377] Logged in from keytab as oryx/127.0.124.130@KRBTEST.COM (short username oryx)
I20260929 22:55:09.747467 6869 webserver.cc:460] Webserver started at http://127.0.124.130:37533/ using document root <none> and password file <none>
I20260929 22:55:09.747705 6869 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:09.747776 6869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:09.747918 6869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:09.749004 6869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "33c2728acb7242c78a7f27de2788575a"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "17c0f2a5d0c094ff35536fbc02b78db8"
server_key_iv: "093c847321a7ce9a4560212013c2423b"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.749351 6869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "33c2728acb7242c78a7f27de2788575a"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "17c0f2a5d0c094ff35536fbc02b78db8"
server_key_iv: "093c847321a7ce9a4560212013c2423b"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.750638 6869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:55:09.751307 6884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.751466 6869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:09.751569 6869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "33c2728acb7242c78a7f27de2788575a"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "17c0f2a5d0c094ff35536fbc02b78db8"
server_key_iv: "093c847321a7ce9a4560212013c2423b"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.751639 6869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:09.768970 6869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:09.771222 6869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:09.771401 6869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:09.771620 6869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:09.771914 6869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:09.771967 6869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.772006 6869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:09.772033 6869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.777487 6869 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:46841
I20260929 22:55:09.777525 6997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:46841 every 8 connection(s)
I20260929 22:55:09.777841 6869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:09.778860 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 6869
I20260929 22:55:09.778965 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:09.779162 498 external_mini_cluster.cc:1428] Setting key 3dead88ffaeabed51f794596289da792
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:55:09.788194 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.778533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:38483 (local address 127.0.124.190:40095)
0929 22:55:09.778587 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:09.778588 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:09.778860 (+ 272us) server_negotiation.cc:407] Connection header received
0929 22:55:09.779559 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:09.779561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:09.779572 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:09.779633 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:09.780941 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.781464 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.782521 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.782711 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.782797 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.785300 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:09.785301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:09.785302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:09.785308 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:09.786718 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.787204 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.787206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.787206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.787265 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.787539 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.787540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.787540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.787649 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:09.787726 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:09.787995 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 22:55:09.788108 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:55:09.788381 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.778513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:38483)
0929 22:55:09.778706 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:09.778754 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:09.779440 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:09.779684 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:09.779687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:09.780546 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:09.780827 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.780833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.781561 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.781562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.782353 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.782355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.782808 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.782809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.782934 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.783448 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:09.783456 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:09.785203 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:09.786802 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.786810 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.786813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.787124 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.787345 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.787346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.787346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.787460 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.787717 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:09.787723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:09.787861 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 22:55:09.787975 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 22:55:09.788132 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260929 22:55:09.788865 6998 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:09.788971 6998 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:09.789139 6998 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
I20260929 22:55:09.789556 6669 ts_manager.cc:194] Registered new tserver with Master: 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.131@KRBTEST.COM" created.
I20260929 22:55:09.789995 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:38483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
I20260929 22:55:09.804489 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:09.887462 7004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:09.887681 7004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:09.887714 7004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:09.888859 7004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:09.888919 7004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:09.888972 7004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:09.890388 7004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:09.890646 7004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:09.890892 7004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:09.895772 7012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.895762 7010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:09.895754 7009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:09.895779 7004 server_base.cc:1034] running on GCE node
I20260929 22:55:09.896266 7004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:09.896472 7004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:09.897660 7004 hybrid_clock.cc:648] HybridClock initialized: now 1790722509897646 us; error 27 us; skew 500 ppm
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:09.900099 7004 init.cc:377] Logged in from keytab as oryx/127.0.124.131@KRBTEST.COM (short username oryx)
I20260929 22:55:09.900532 7004 webserver.cc:460] Webserver started at http://127.0.124.131:42001/ using document root <none> and password file <none>
I20260929 22:55:09.900754 7004 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:09.900817 7004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:09.900955 7004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:09.901898 7004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "46005e38018f486c84c8b2722d083cd6"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "8b270236e52a04e4e45c576ac3e3069c"
server_key_iv: "ede9350ee648975d0b983e5321e6c3e7"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.902261 7004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "46005e38018f486c84c8b2722d083cd6"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "8b270236e52a04e4e45c576ac3e3069c"
server_key_iv: "ede9350ee648975d0b983e5321e6c3e7"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.903609 7004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:09.904340 7019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.904507 7004 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.904601 7004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "46005e38018f486c84c8b2722d083cd6"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "8b270236e52a04e4e45c576ac3e3069c"
server_key_iv: "ede9350ee648975d0b983e5321e6c3e7"
server_key_version: "encryptionkey@0"
I20260929 22:55:09.904680 7004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:09.916426 7004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:09.918363 7004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:09.918526 7004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:09.918733 7004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:09.919019 7004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:09.919073 7004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.919114 7004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:09.919140 7004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:09.924692 7004 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:39553
I20260929 22:55:09.924767 7134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:39553 every 8 connection(s)
I20260929 22:55:09.925117 7004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:09.928932 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7004
I20260929 22:55:09.929014 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:09.929227 498 external_mini_cluster.cc:1428] Setting key a10d281ccf002ecece767d40e9c92cb6
Sep 29 22:55:09 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:09.934233 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.925822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:36021 (local address 127.0.124.190:40095)
0929 22:55:09.925884 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:09.925885 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:09.926053 (+ 168us) server_negotiation.cc:407] Connection header received
0929 22:55:09.926513 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:09.926514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:09.926523 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:09.926586 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:09.927408 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.927978 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.929178 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.929506 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.929619 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.931706 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:09.931707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:09.931707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:09.931714 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:09.933207 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.933540 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.933540 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.933540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.933588 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:09.933778 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:09.933779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:09.933779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:09.933873 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:09.933921 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:09.934117 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 22:55:09.934173 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:55:09.934450 7137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:09.925807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:36021)
0929 22:55:09.925945 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:09.925985 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:09.926427 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:09.926637 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:09.926640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:09.927162 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:09.927339 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.927343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.928039 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.928040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.929046 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:09.929049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:09.929628 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:09.929629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:09.929767 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:09.930290 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:09.930298 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:09.931602 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:09.933273 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.933278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.933279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.933470 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.933642 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:09.933643 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:09.933643 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:09.933728 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:09.933923 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:09.933927 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:09.934027 (+ 100us) client_negotiation.cc:769] Sending connection context
0929 22:55:09.934105 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:55:09.934210 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":77,"threads_started":1}
I20260929 22:55:09.934918 7135 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:09.935009 7135 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:09.935128 7135 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
I20260929 22:55:09.935456 6669 ts_manager.cc:194] Registered new tserver with Master: 46005e38018f486c84c8b2722d083cd6 (127.0.124.131:39553)
I20260929 22:55:09.935822 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:36021
I20260929 22:55:09.941111 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.124.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.189.keytab.
Entry for principal oryx/127.0.124.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.189.keytab.
I20260929 22:55:09.966997 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:42123
--webserver_interface=127.0.124.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.189.keytab
--principal=oryx/127.0.124.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40095,127.0.124.189:42123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:10.048169 7140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:10.048388 7140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:10.048422 7140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:10.049504 7140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:10.049587 7140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:10.049610 7140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:10.049638 7140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:10.049669 7140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:10.051088 7140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40095,127.0.124.189:42123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.189.keytab
--principal=oryx/127.0.124.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:42123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.124.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
W20260929 22:55:10.051218 7140 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.0.124.190:40095,127.0.124.189:42123'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260929 22:55:10.051370 7140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:10.051578 7140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.056341 7145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.056365 7146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.056345 7148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.056588 7140 server_base.cc:1034] running on GCE node
I20260929 22:55:10.056797 7140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.057008 7140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.058137 7140 hybrid_clock.cc:648] HybridClock initialized: now 1790722510058120 us; error 32 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.060551 7140 init.cc:377] Logged in from keytab as oryx/127.0.124.189@KRBTEST.COM (short username oryx)
I20260929 22:55:10.061058 7140 webserver.cc:460] Webserver started at http://127.0.124.189:42335/ using document root <none> and password file <none>
I20260929 22:55:10.061286 7140 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.061329 7140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.061470 7140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:10.062608 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/instance:
uuid: "4c339ac21f6f42cfbc41525af36d1f39"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "c5e55d32fc8bc595c65b61c8ccdfc83c"
server_key_iv: "f8df806c96a0741ec10c5b4781407f28"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.062942 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal/instance:
uuid: "4c339ac21f6f42cfbc41525af36d1f39"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "c5e55d32fc8bc595c65b61c8ccdfc83c"
server_key_iv: "f8df806c96a0741ec10c5b4781407f28"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.064185 7140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:55:10.064996 7155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.065194 7140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:10.065275 7140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "4c339ac21f6f42cfbc41525af36d1f39"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "c5e55d32fc8bc595c65b61c8ccdfc83c"
server_key_iv: "f8df806c96a0741ec10c5b4781407f28"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.065339 7140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.082110 7140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.084445 7140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:10.084619 7140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.088925 7140 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.189:42123
I20260929 22:55:10.088971 7207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.189:42123 every 8 connection(s)
I20260929 22:55:10.089341 7140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
I20260929 22:55:10.090273 7208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:10.091169 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7140
I20260929 22:55:10.092100 7208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.189@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.100914 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.093187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.0.124.190:40095)
0929 22:55:10.093237 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.093238 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.093382 (+ 144us) server_negotiation.cc:407] Connection header received
0929 22:55:10.093449 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.093450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.093461 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.093515 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.093958 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.094441 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.095345 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.095538 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.095629 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.097872 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.097873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.097873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.097881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.099332 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.099811 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.099812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.099812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.099860 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.100130 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.100130 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.100131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.100347 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.100422 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.100741 (+ 319us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.100831 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:55:10.101073 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.093135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58268)
0929 22:55:10.093277 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.093313 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.093386 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.093545 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.093548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.093765 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.093857 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.093861 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.094555 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.094556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.095243 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.095245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.095637 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.095638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.095711 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.096358 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.096366 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.097764 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.099405 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.099412 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.099414 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.099739 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.099938 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.099939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.099939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.100065 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.100417 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.100421 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.100566 (+ 145us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.100694 (+ 128us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.100865 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260929 22:55:10.101691 7208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:55:10.101769 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.091793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51726 (local address 127.0.124.189:42123)
0929 22:55:10.091948 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.091959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.092041 (+ 82us) server_negotiation.cc:407] Connection header received
0929 22:55:10.092698 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.092705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.092774 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.092937 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.093630 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.094498 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.095251 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.095555 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.095670 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.098270 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.098277 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.098277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.098284 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.100186 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.100584 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.100586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.100586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.100643 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.100845 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.100846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.100846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.100995 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.101133 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.101566 (+ 433us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.101650 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.189@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.107270 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.101961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51742)
0929 22:55:10.101989 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.101998 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.102037 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.102154 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.102155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.102279 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.102326 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.102327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.102920 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.102920 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.103392 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.103393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.103755 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.103756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.103811 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.104198 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.104203 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.105331 (+ 1128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.106527 (+ 1196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.106528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.106528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.106689 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.106831 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.106831 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.106831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.106870 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.107013 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.107014 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.107067 (+ 53us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.107150 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.107217 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260929 22:55:10.107395 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.101993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51742 (local address 127.0.124.189:42123)
0929 22:55:10.102024 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.102025 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.102033 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:10.102092 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.102093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.102100 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.102151 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.102389 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.102856 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.103463 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.103691 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.103742 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.105399 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.105400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.105400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.105405 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.106438 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.106748 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.106748 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.106749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.106793 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.106902 (+ 109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.106902 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.106903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.106978 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.107022 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.107179 (+ 157us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.107261 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":18}
I20260929 22:55:10.108704 7208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Bootstrap starting.
I20260929 22:55:10.109470 7208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:10.109737 7208 log.cc:824] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:10.110414 7208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: No bootstrap required, opened a new log
I20260929 22:55:10.111761 7208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } }
I20260929 22:55:10.111879 7208 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:10.111925 7208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c339ac21f6f42cfbc41525af36d1f39, State: Initialized, Role: FOLLOWER
I20260929 22:55:10.112054 7208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } }
I20260929 22:55:10.112336 7214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } } }
I20260929 22:55:10.112361 7208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:10.112421 7214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:55:10.113989 7225 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:55:10.114048 7225 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:55:10.115428 7140 master_runner.cc:428] Detected that this master 4c339ac21f6f42cfbc41525af36d1f39 is joining an existing cluster
I20260929 22:55:10.115465 7140 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.124.189:42123
I20260929 22:55:10.122201 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.116564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58284 (local address 127.0.124.190:40095)
0929 22:55:10.116606 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.116608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.116734 (+ 126us) server_negotiation.cc:407] Connection header received
0929 22:55:10.116805 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.116806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.116816 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.116870 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.117195 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.117674 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.118428 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.118629 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.118702 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.119595 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.119596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.119596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.119604 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.121086 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.121461 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.121461 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.121462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.121525 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.121704 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.121705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.121705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.121821 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.121868 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.122042 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.122112 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:10.122215 7232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.116535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58284)
0929 22:55:10.116679 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.116689 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.116747 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.116874 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.116875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.117056 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.117116 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.117117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.117754 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.117756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.118331 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.118333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.118714 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.118715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.118773 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.119219 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.119223 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.119508 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.121167 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.121168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.121168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.121380 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.121593 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.121594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.121594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.121645 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.121904 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.121905 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.121935 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.122015 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.122112 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":94,"threads_started":1}
I20260929 22:55:10.127092 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.116692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51748 (local address 127.0.124.189:42123)
0929 22:55:10.116749 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.116751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.120621 (+ 3870us) server_negotiation.cc:407] Connection header received
0929 22:55:10.120651 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.120652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.120661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.120724 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.121083 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.121762 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.123157 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.123411 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.123493 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.124591 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.124592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.124592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.124598 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.125980 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.126328 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.126329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.126329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.126382 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.126570 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.126571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.126571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.126668 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.126743 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.126890 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.127013 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":40}
I20260929 22:55:10.127091 7231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.116536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51748)
0929 22:55:10.120539 (+ 4003us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.120549 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.120609 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.120738 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.120739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.120940 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.121001 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.121003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.121850 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.121851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.123066 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.123068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.123617 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.123617 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.123673 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.124087 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.124092 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.124497 (+ 405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.126083 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.126084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.126085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.126247 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.126445 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.126446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.126447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.126500 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.126734 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.126735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.126785 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.126871 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.126965 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3985,"thread_start_us":75,"threads_started":1}
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.190@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.132550 7233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.124358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51754)
0929 22:55:10.124496 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.124540 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.124600 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.125032 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.125038 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.125354 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.125405 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.125407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.126341 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.126342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.127636 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.127639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.128017 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.128018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.128100 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.128545 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.128549 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.129877 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.131409 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.131416 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.131419 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.131620 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.131836 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.131837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.131837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.131896 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.132147 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.132154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.132204 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.132340 (+ 136us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.132456 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260929 22:55:10.132560 7234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.124548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51754 (local address 127.0.124.189:42123)
0929 22:55:10.124876 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.124878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.124884 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:55:10.124915 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.124915 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.124926 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.125009 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.125497 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.126252 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.127710 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.127902 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.127988 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.129963 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.129964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.129965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.129971 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.131311 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.131708 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.131709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.131710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.131764 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.131969 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.131970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.131970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.132079 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.132155 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.132364 (+ 209us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.132445 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":64,"threads_started":1}
I20260929 22:55:10.133118 6669 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.124.189:42123: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39"
member_type: NON_VOTER
last_known_addr {
host: "127.0.124.189"
port: 42123
}
attrs {
promote: true
}
}
dest_uuid: "356f9818428a4b799a41e354aa6841ad"
cas_config_opid_index: -1
I20260929 22:55:10.133452 6669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } }
I20260929 22:55:10.133942 7236 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } }
I20260929 22:55:10.134182 7182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:10.134909 7182 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260929 22:55:10.134955 7236 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.124.189:42123
I20260929 22:55:10.135033 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } }
I20260929 22:55:10.135095 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.135196 7140 master.cc:537] Master@127.0.124.189:42123 shutting down...
I20260929 22:55:10.135417 7235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:55:10.136088 6655 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260929 22:55:10.136600 6655 consensus_peers.cc:487] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad -> Peer 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189:42123): Couldn't send request to peer 4c339ac21f6f42cfbc41525af36d1f39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 22:55:10.138056 7140 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:10.138144 7140 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:10.138193 7140 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: stopping tablet replica
I20260929 22:55:10.151388 7140 master.cc:552] Master@127.0.124.189:42123 shutdown complete.
I20260929 22:55:10.151469 7140 master_runner.cc:305] Clearing existing system tablet
I20260929 22:55:10.151610 7140 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.151675 7140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.152315 7140 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260929 22:55:10.152849 7240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.152987 7140 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.153046 7140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:10.153070 7140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "4c339ac21f6f42cfbc41525af36d1f39"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "c5e55d32fc8bc595c65b61c8ccdfc83c"
server_key_iv: "f8df806c96a0741ec10c5b4781407f28"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.153749 7140 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:10.155150 7140 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 22:55:10.155232 7140 log.cc:1196] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260929 22:55:10.155447 7140 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Deleting consensus metadata
I20260929 22:55:10.155588 7140 master_runner.cc:315] Copying system tablet from 127.0.124.190:40095
I20260929 22:55:10.156284 7140 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: tablet copy: Beginning tablet copy session from remote peer at address 127.0.124.190:40095
I20260929 22:55:10.163007 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.156675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.0.124.190:40095)
0929 22:55:10.156723 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.156725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.156785 (+ 60us) server_negotiation.cc:407] Connection header received
0929 22:55:10.156860 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.156861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.156869 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.156917 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.157277 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.157763 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.158865 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.159105 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.159179 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.160270 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.160272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.160272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.160280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.161870 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.162325 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.162326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.162327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.162390 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.162589 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.162589 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.162590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.162687 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.162734 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.162885 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.162939 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:55:10.163348 7246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.156588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58300)
0929 22:55:10.156709 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.156721 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.156795 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.156942 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.156943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.157146 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.157206 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.157208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.157842 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.157843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.158725 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.158728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.159194 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.159196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.159263 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.159724 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.159729 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.160132 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.161952 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.161953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.161954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.162199 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.162461 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.162462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.162462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.162529 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.162746 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.162747 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.162792 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.162870 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.162984 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":81,"threads_started":1}
I20260929 22:55:10.163683 6689 tablet_copy_service.cc:140] P 356f9818428a4b799a41e354aa6841ad: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4c339ac21f6f42cfbc41525af36d1f39 ({username='oryx', principal='oryx/127.0.124.189@KRBTEST.COM'} at 127.0.0.1:58300)
I20260929 22:55:10.163782 6689 tablet_copy_service.cc:161] P 356f9818428a4b799a41e354aa6841ad: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4c339ac21f6f42cfbc41525af36d1f39 at {username='oryx', principal='oryx/127.0.124.189@KRBTEST.COM'} at 127.0.0.1:58300: session id = 4c339ac21f6f42cfbc41525af36d1f39-00000000000000000000000000000000
I20260929 22:55:10.164499 6689 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 22:55:10.165124 7140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 22:55:10.166023 7140 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: tablet copy: Starting download of 0 data blocks...
I20260929 22:55:10.166184 7140 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: tablet copy: Starting download of 1 WAL segments...
I20260929 22:55:10.166967 7140 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 22:55:10.167758 6689 tablet_copy_service.cc:342] P 356f9818428a4b799a41e354aa6841ad: Request end of tablet copy session 4c339ac21f6f42cfbc41525af36d1f39-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.124.189@KRBTEST.COM'} at 127.0.0.1:58300
I20260929 22:55:10.167814 6689 tablet_copy_service.cc:433] P 356f9818428a4b799a41e354aa6841ad: ending tablet copy session 4c339ac21f6f42cfbc41525af36d1f39-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4c339ac21f6f42cfbc41525af36d1f39
I20260929 22:55:10.170138 7140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.171262 7247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.171296 7248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.171545 7140 server_base.cc:1034] running on GCE node
W20260929 22:55:10.172325 7250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.172523 7140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.172652 7140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.173774 7140 hybrid_clock.cc:648] HybridClock initialized: now 1790722510173756 us; error 35 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.175000 7140 init.cc:377] Logged in from keytab as oryx/127.0.124.189@KRBTEST.COM (short username oryx)
I20260929 22:55:10.175280 7140 webserver.cc:460] Webserver started at http://127.0.124.189:38005/ using document root <none> and password file <none>
I20260929 22:55:10.175412 7140 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.175453 7140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.176069 7140 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:10.176620 7257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.176740 7140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.176786 7140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "4c339ac21f6f42cfbc41525af36d1f39"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "c5e55d32fc8bc595c65b61c8ccdfc83c"
server_key_iv: "f8df806c96a0741ec10c5b4781407f28"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.176841 7140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.193766 7140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.195371 7140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.198598 7140 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.189:42123
I20260929 22:55:10.198621 7309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.189:42123 every 8 connection(s)
I20260929 22:55:10.198910 7140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
I20260929 22:55:10.199795 7310 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:55:10.200383 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Bootstrap starting.
I20260929 22:55:10.203316 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:55:10.203538 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: Bootstrap complete.
I20260929 22:55:10.203765 7310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } }
I20260929 22:55:10.203855 7310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4c339ac21f6f42cfbc41525af36d1f39, State: Initialized, Role: LEARNER
I20260929 22:55:10.203892 7310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } }
I20260929 22:55:10.204056 7310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:10.204079 7314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } }
I20260929 22:55:10.204310 7314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:55:10.205682 7325 catalog_manager.cc:1259] Loaded cluster ID: 82646f2b675a4d3999ef5ccec68a57ff
I20260929 22:55:10.205735 7325 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: loading cluster ID for follower catalog manager: success
I20260929 22:55:10.207190 7325 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: acquiring CA information for follower catalog manager: success
I20260929 22:55:10.207546 7325 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:55:10.211284 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.203202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51774 (local address 127.0.124.189:42123)
0929 22:55:10.203319 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.203321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.203332 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:55:10.203357 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.203357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.203368 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.204192 (+ 824us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.204262 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.205161 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.206094 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.206403 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.206467 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.207944 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.207946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.207946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.207953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.210203 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.210533 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.210535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.210535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.210602 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.210787 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.210787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.210788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.210918 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.211027 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.211106 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.211195 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for oryx/127.0.124.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.188.keytab.
Entry for principal oryx/127.0.124.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.188.keytab.
I20260929 22:55:10.235947 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:46219
--webserver_interface=127.0.124.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.188.keytab
--principal=oryx/127.0.124.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:10.319142 7328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:10.319355 7328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:10.319391 7328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:10.320562 7328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:10.320617 7328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:10.320639 7328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:10.320670 7328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:10.320711 7328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:10.322250 7328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.188.keytab
--principal=oryx/127.0.124.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:46219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.124.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:10.322505 7328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:10.322714 7328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:55:10.327761 7328 server_base.cc:1034] running on GCE node
W20260929 22:55:10.327584 7333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.327579 7334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.327596 7336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.328390 7328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.328755 7328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.329936 7328 hybrid_clock.cc:648] HybridClock initialized: now 1790722510329917 us; error 37 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.332931 7328 init.cc:377] Logged in from keytab as oryx/127.0.124.188@KRBTEST.COM (short username oryx)
I20260929 22:55:10.333463 7328 webserver.cc:460] Webserver started at http://127.0.124.188:39059/ using document root <none> and password file <none>
I20260929 22:55:10.333719 7328 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.333770 7328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.333966 7328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:10.335119 7328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/instance:
uuid: "072ebd1186bc446ba3f04198e84e6e73"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "340235549e3417aa7539b2a200300ef0"
server_key_iv: "a16a373f3bf528d30d607a3db340039a"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.335532 7328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal/instance:
uuid: "072ebd1186bc446ba3f04198e84e6e73"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "340235549e3417aa7539b2a200300ef0"
server_key_iv: "a16a373f3bf528d30d607a3db340039a"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.337229 7328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260929 22:55:10.338117 7343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.338279 7328 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:10.338399 7328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "072ebd1186bc446ba3f04198e84e6e73"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "340235549e3417aa7539b2a200300ef0"
server_key_iv: "a16a373f3bf528d30d607a3db340039a"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.338485 7328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.377163 7328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.379801 7328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:10.379925 7328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.384522 7328 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.188:46219
I20260929 22:55:10.384588 7395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.188:46219 every 8 connection(s)
I20260929 22:55:10.384941 7328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
I20260929 22:55:10.385902 7396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:10.387405 7396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:55:10.392721 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7328
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.188@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:10.396891 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.388195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58314 (local address 127.0.124.190:40095)
0929 22:55:10.388275 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.388277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.388378 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:55:10.388867 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.388868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.388881 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.388937 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.389527 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.390024 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.391051 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.391255 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.391339 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.393634 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.393636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.393636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.393645 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.395184 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.395811 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.395812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.395813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.395863 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.396174 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.396175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.396175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.396315 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.396367 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.396723 (+ 356us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.396799 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 22:55:10.397234 7398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.388057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58314)
0929 22:55:10.388204 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.388283 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.388764 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.389014 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.389017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.389251 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.389432 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.389436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.390126 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.390127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.390955 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.390957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.391358 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.391360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.391482 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.391907 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.391915 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.393547 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.395285 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.395292 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.395294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.395693 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.395932 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.395932 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.395933 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.396095 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.396387 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.396394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.396551 (+ 157us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.396695 (+ 144us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.396855 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260929 22:55:10.397850 7396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.188@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.404112 7399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.393366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.0.124.188:46219)
0929 22:55:10.393488 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.393492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.393507 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:55:10.393525 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.393527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.393543 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.393632 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.394434 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.395468 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.396700 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.397141 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.397212 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.400346 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.400353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.400353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.400409 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.402627 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.403006 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.403009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.403009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.403081 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.403319 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.403320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.403320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.403496 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.403667 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.403773 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.403861 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
I20260929 22:55:10.405850 7398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.398153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51784)
0929 22:55:10.398313 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.398333 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.398387 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.398678 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.398679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.398822 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.398899 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.398901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.399954 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.399955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.400631 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.400633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.401043 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.401043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.401108 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.401476 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.401480 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.402922 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.404849 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.404850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.404851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.405034 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.405258 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.405259 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.405259 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.405313 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.405574 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.405575 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.405613 (+ 38us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.405680 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.405767 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260929 22:55:10.405861 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.398240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51784 (local address 127.0.124.189:42123)
0929 22:55:10.398315 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.398317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.398374 (+ 57us) server_negotiation.cc:407] Connection header received
0929 22:55:10.398587 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.398588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.398600 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.398656 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.398983 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.399823 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.400768 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.400965 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.401043 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.403093 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.403094 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.403094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.403102 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.404757 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.405107 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.405108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.405108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.405163 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.405385 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.405386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.405386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.405511 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.405582 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.405706 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.405781 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:55:10.406348 7396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.188@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
I20260929 22:55:10.411916 7398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.406604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.0.1:35976)
0929 22:55:10.406657 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.406667 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.406719 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.406849 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.406850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.406983 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.407011 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.407012 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.407569 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.407570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.408175 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.408177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.408568 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.408569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.408610 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.408908 (+ 298us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.408912 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.409941 (+ 1029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.411183 (+ 1242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.411184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.411184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.411332 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.411508 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.411508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.411509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.411555 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.411721 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.411722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.411751 (+ 29us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.411800 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.411863 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:55:10.411976 7399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.406646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35976 (local address 127.0.124.188:46219)
0929 22:55:10.406677 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.406678 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.406715 (+ 37us) server_negotiation.cc:407] Connection header received
0929 22:55:10.406794 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.406795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.406802 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.406844 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.407064 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.407497 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.408324 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.408503 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.408553 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.410012 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.410013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.410014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.410019 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.411116 (+ 1097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.411393 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.411394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.411394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.411440 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.411598 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.411598 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.411598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.411675 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.411717 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.411813 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.411903 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":16}
I20260929 22:55:10.413290 7396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Bootstrap starting.
I20260929 22:55:10.414059 7396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:10.414324 7396 log.cc:824] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:10.414961 7396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: No bootstrap required, opened a new log
I20260929 22:55:10.416385 7396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } }
I20260929 22:55:10.416494 7396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:10.416515 7396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072ebd1186bc446ba3f04198e84e6e73, State: Initialized, Role: FOLLOWER
I20260929 22:55:10.416653 7396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } }
I20260929 22:55:10.416942 7396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:10.416899 7401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } } }
I20260929 22:55:10.417016 7401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:55:10.418552 7412 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:55:10.418614 7412 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:55:10.420732 7328 master_runner.cc:428] Detected that this master 072ebd1186bc446ba3f04198e84e6e73 is joining an existing cluster
I20260929 22:55:10.420781 7328 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.124.188:46219
I20260929 22:55:10.444413 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.421728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58330 (local address 127.0.124.190:40095)
0929 22:55:10.421768 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.421770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.421933 (+ 163us) server_negotiation.cc:407] Connection header received
0929 22:55:10.422022 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.422024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.422035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.422102 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.422493 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.423264 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424469 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424787 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424829 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.440996 (+ 16167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.440999 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.440999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.441008 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.443015 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443489 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.443490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.443491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.443552 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443769 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.443770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.443770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.443917 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.443959 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.444184 (+ 225us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.444293 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:10.444732 7399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.422099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.0.124.188:46219)
0929 22:55:10.422129 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.422131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.422223 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:55:10.422298 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.422298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.422305 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.422329 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.423651 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424341 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.425304 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.425496 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.425565 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.441140 (+ 15575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.441141 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.441141 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.441149 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.443613 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443954 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.443955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.443956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.443999 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.444229 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.444229 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.444230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.444341 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.444379 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.444555 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.444636 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:55:10.445016 7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.421899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.0.1:35978)
0929 22:55:10.422175 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.422183 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.422241 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.422378 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.422379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.423512 (+ 1133us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.423570 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.423572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424433 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.425218 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.425220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.425564 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.425565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.425628 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.426049 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.426053 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.441060 (+ 15007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.443694 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443694 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.443695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.443885 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.444059 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.444059 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.444059 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.444148 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.444417 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.444418 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.444458 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.444839 (+ 381us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.444922 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":54,"threads_started":1}
I20260929 22:55:10.445017 7418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.421757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58330)
0929 22:55:10.421879 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.421887 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.421955 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.422161 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.422162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.422367 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.422434 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.422435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.423391 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.423392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.424366 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.424368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424914 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.424975 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.425637 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.425642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.440880 (+ 15238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.443103 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.443105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.443380 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.443630 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.443630 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.443631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.443693 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.444007 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.444008 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.444066 (+ 58us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.444567 (+ 501us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.444696 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":21,"thread_start_us":64,"threads_started":1}
I20260929 22:55:10.446219 7419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.421706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51798)
0929 22:55:10.421871 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.421880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.421925 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.422203 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.422203 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.422485 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.422548 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.422550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.423377 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.423378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.424370 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.424372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424917 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.424981 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.441184 (+ 16203us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.441189 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.441617 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.444053 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.444053 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.444054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.444295 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.445510 (+ 1215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.445511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.445511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.445577 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.445877 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.445878 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.445916 (+ 38us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.445976 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.446096 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":61,"thread_start_us":78,"threads_started":1}
I20260929 22:55:10.446583 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.422035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51798 (local address 127.0.124.189:42123)
0929 22:55:10.422086 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.422088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.422094 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:55:10.422112 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.422113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.422121 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.422166 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.422626 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.423300 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424491 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.424791 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.424832 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.441713 (+ 16881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.441716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.441716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.441725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.443959 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.444374 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.444375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.444376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.444429 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.445663 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.445664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.445664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.445795 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.445845 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.446255 (+ 410us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.446352 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722509, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.190@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
I20260929 22:55:10.453738 7399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.447098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35986 (local address 127.0.124.188:46219)
0929 22:55:10.447154 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.447156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.447165 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:10.447194 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.447195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.447204 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.447263 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.447478 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.448187 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.448856 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.449152 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.449215 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.451079 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.451080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.451080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.451087 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.452570 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.452959 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.452960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.452961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.453014 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.453238 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.453239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.453239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.453358 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.453427 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.453588 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.453656 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:55:10.453740 7233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.447015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.0.1:35986)
0929 22:55:10.447051 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.447062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.447101 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.447265 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.447265 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.447381 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.447416 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.447418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.448292 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.448293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.448791 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.448793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.449217 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.449217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.449258 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.449639 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.449644 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.450996 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.452667 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.452668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.452669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.452871 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.453085 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.453086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.453086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.453154 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.453437 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.453438 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.453480 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.453551 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.453645 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260929 22:55:10.454208 6669 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.124.188:46219: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73"
member_type: NON_VOTER
last_known_addr {
host: "127.0.124.188"
port: 46219
}
attrs {
promote: true
}
}
dest_uuid: "356f9818428a4b799a41e354aa6841ad"
cas_config_opid_index: 5
I20260929 22:55:10.454409 6669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } }
I20260929 22:55:10.454725 7236 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.455098 7370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:10.455637 7236 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.124.188:46219
I20260929 22:55:10.455716 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.455811 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.455915 7370 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 22:55:10.456197 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6732
I20260929 22:55:10.457415 7328 master.cc:537] Master@127.0.124.188:46219 shutting down...
I20260929 22:55:10.458492 7235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:55:10.459117 6655 consensus_peers.cc:487] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad -> Peer 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188:46219): Couldn't send request to peer 072ebd1186bc446ba3f04198e84e6e73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 22:55:10.459295 7233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.454838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51814)
0929 22:55:10.456104 (+ 1266us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.456122 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.456182 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.456394 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.456395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.456396 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:10.456428 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.456430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.457230 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.457231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.458373 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.458375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.459070 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.459071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.459125 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.459145 (+ 20us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.459197 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.459231 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1251}
I20260929 22:55:10.459312 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.454886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51814 (local address 127.0.124.189:42123)
0929 22:55:10.455066 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.455068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.456172 (+ 1104us) server_negotiation.cc:407] Connection header received
0929 22:55:10.456278 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.456279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.456301 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.456352 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:10.456493 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.457124 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.458469 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.458969 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.459068 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.459142 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.459214 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.459254 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260929 22:55:10.459551 7284 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 LEARNER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 22:55:10.459810 7235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 22:55:10.460398 7284 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.461462 7422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.461555 7422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:55:10.461634 7314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 356f9818428a4b799a41e354aa6841ad. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: NON_VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: true } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.461740 7314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:55:10.461912 7235 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: attempting to promote NON_VOTER 4c339ac21f6f42cfbc41525af36d1f39 to VOTER
I20260929 22:55:10.462101 7235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } }
I20260929 22:55:10.462714 7284 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 LEARNER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260929 22:55:10.462900 6655 consensus_peers.cc:487] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad -> Peer 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188:46219): Couldn't send request to peer 072ebd1186bc446ba3f04198e84e6e73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 22:55:10.463001 7236 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 22:55:10.463690 7328 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:10.463776 7328 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:10.463827 7328 tablet_replica.cc:330] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: stopping tablet replica
I20260929 22:55:10.463979 7236 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.464627 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:36595
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:40095
--webserver_port=38417
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:55:10.464885 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.464948 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.464999 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.465039 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.465580 7284 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.466339 7314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.466411 7314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:55:10.477619 7328 master.cc:552] Master@127.0.124.188:46219 shutdown complete.
I20260929 22:55:10.477664 7328 master_runner.cc:305] Clearing existing system tablet
I20260929 22:55:10.477819 7328 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.477860 7328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.478545 7328 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:10.479089 7426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.479189 7328 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.479231 7328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:10.479250 7328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "072ebd1186bc446ba3f04198e84e6e73"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "340235549e3417aa7539b2a200300ef0"
server_key_iv: "a16a373f3bf528d30d607a3db340039a"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.479957 7328 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:10.481518 7328 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 22:55:10.481593 7328 log.cc:1196] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260929 22:55:10.481813 7328 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Deleting consensus metadata
I20260929 22:55:10.481945 7328 master_runner.cc:315] Copying system tablet from 127.0.124.190:40095
I20260929 22:55:10.482524 7328 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: tablet copy: Beginning tablet copy session from remote peer at address 127.0.124.190:40095
I20260929 22:55:10.489531 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.482806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58334)
0929 22:55:10.482913 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.482923 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.482975 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.483120 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.483121 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.483323 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.483390 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.483392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.484324 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.484325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.485195 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.485197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.485700 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.485701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.485792 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.486316 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.486321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.486704 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.488513 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.488514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.488514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.488722 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.488929 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.488929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.488930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.488998 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.489244 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.489245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.489288 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.489353 (+ 65us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.489445 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":61,"threads_started":1}
I20260929 22:55:10.489548 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.482855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58334 (local address 127.0.124.190:40095)
0929 22:55:10.482897 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.482899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.482962 (+ 63us) server_negotiation.cc:407] Connection header received
0929 22:55:10.483033 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.483034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.483043 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.483114 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.483468 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.484255 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.485303 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.485610 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.485675 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.486795 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.486797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.486797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.486805 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.488435 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.488804 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.488805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.488806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.488861 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.489065 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.489065 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.489066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.489181 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.489241 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.489386 (+ 145us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.489461 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:10.489971 6689 tablet_copy_service.cc:140] P 356f9818428a4b799a41e354aa6841ad: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 072ebd1186bc446ba3f04198e84e6e73 ({username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:58334)
I20260929 22:55:10.490018 6689 tablet_copy_service.cc:161] P 356f9818428a4b799a41e354aa6841ad: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 072ebd1186bc446ba3f04198e84e6e73 at {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:58334: session id = 072ebd1186bc446ba3f04198e84e6e73-00000000000000000000000000000000
I20260929 22:55:10.490595 6689 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 22:55:10.491035 7328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 22:55:10.492148 7328 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: tablet copy: Starting download of 0 data blocks...
I20260929 22:55:10.492326 7328 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: tablet copy: Starting download of 1 WAL segments...
I20260929 22:55:10.493021 7328 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 22:55:10.493849 6689 tablet_copy_service.cc:342] P 356f9818428a4b799a41e354aa6841ad: Request end of tablet copy session 072ebd1186bc446ba3f04198e84e6e73-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:58334
I20260929 22:55:10.493896 6689 tablet_copy_service.cc:433] P 356f9818428a4b799a41e354aa6841ad: ending tablet copy session 072ebd1186bc446ba3f04198e84e6e73-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 072ebd1186bc446ba3f04198e84e6e73
I20260929 22:55:10.497766 7328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.498932 7433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.501200 7434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.501559 7328 server_base.cc:1034] running on GCE node
W20260929 22:55:10.504369 7436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.504595 7328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.504740 7328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.505844 7328 hybrid_clock.cc:648] HybridClock initialized: now 1790722510505811 us; error 49 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.507422 7328 init.cc:377] Logged in from keytab as oryx/127.0.124.188@KRBTEST.COM (short username oryx)
I20260929 22:55:10.507673 7328 webserver.cc:460] Webserver started at http://127.0.124.188:38335/ using document root <none> and password file <none>
I20260929 22:55:10.507784 7328 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.507817 7328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.508608 7328 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:10.509181 7443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.509326 7328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:10.509374 7328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "072ebd1186bc446ba3f04198e84e6e73"
format_stamp: "Formatted at 2026-09-29 22:55:10 on dist-test-slave-512q"
server_key: "340235549e3417aa7539b2a200300ef0"
server_key_iv: "a16a373f3bf528d30d607a3db340039a"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.509428 7328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.524196 7328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.526028 7328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.528846 7328 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.188:46219
I20260929 22:55:10.529160 7328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
I20260929 22:55:10.529459 7496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.188:46219 every 8 connection(s)
I20260929 22:55:10.530200 7497 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:55:10.530646 7497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Bootstrap starting.
I20260929 22:55:10.533420 7497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:55:10.533628 7497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Bootstrap complete.
I20260929 22:55:10.533790 7497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } }
I20260929 22:55:10.533871 7497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 072ebd1186bc446ba3f04198e84e6e73, State: Initialized, Role: LEARNER
I20260929 22:55:10.533902 7497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } }
I20260929 22:55:10.534091 7497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:10.534102 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.534420 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:55:10.535461 7511 catalog_manager.cc:1259] Loaded cluster ID: 82646f2b675a4d3999ef5ccec68a57ff
I20260929 22:55:10.535543 7511 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: loading cluster ID for follower catalog manager: success
I20260929 22:55:10.537139 7511 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: acquiring CA information for follower catalog manager: success
I20260929 22:55:10.537516 7511 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260929 22:55:10.563993 7424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:10.564209 7424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:10.564284 7424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:10.565428 7424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:10.565495 7424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:10.565538 7424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:10.566962 7424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:36595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=38417
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:10.567214 7424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:10.567436 7424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.572424 7517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.572508 7516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.572431 7519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.572558 7424 server_base.cc:1034] running on GCE node
I20260929 22:55:10.572834 7424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.573083 7424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.574250 7424 hybrid_clock.cc:648] HybridClock initialized: now 1790722510574248 us; error 41 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.576821 7424 init.cc:377] Logged in from keytab as oryx/127.0.124.129@KRBTEST.COM (short username oryx)
I20260929 22:55:10.577261 7424 webserver.cc:460] Webserver started at http://127.0.124.129:38417/ using document root <none> and password file <none>
I20260929 22:55:10.577502 7424 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.577582 7424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.578967 7424 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:10.579523 7526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.579689 7424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.579784 7424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "27e2925b69964ad99ac5b3800905c319"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "cc436b7a7f631eb13b4ff711c2ac3601"
server_key_iv: "986ac0e7be93143714b4610e89cd479e"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.580127 7424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.591109 7424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.593333 7424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:10.593495 7424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.593706 7424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:10.594002 7424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:10.594060 7424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.594101 7424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:10.594129 7424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.599676 7424 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:36595
I20260929 22:55:10.599768 7639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:36595 every 8 connection(s)
I20260929 22:55:10.600090 7424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:10.602007 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7424
I20260929 22:55:10.602193 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6869
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:10.608256 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:46841
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:40095
--webserver_port=37533
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
I20260929 22:55:10.612313 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.600793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:58473 (local address 127.0.124.190:40095)
0929 22:55:10.600836 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.600838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.601065 (+ 227us) server_negotiation.cc:407] Connection header received
0929 22:55:10.601735 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.601736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.601749 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.601800 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.603006 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.603863 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.605537 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.605747 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.605780 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.608418 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.608420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.608420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.608428 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.610627 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.611128 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.611130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.611130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.611190 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.611462 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.611463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.611463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.611607 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.611664 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.612059 (+ 395us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.612150 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:10.612849 7644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.600759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:58473)
0929 22:55:10.600911 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.600972 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.601625 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.601866 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.601870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.602202 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.602906 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.602908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.604020 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.604021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.605434 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.605437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.605848 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.605848 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.605940 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.606474 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.606482 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.608077 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.610717 (+ 2640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.610722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.610725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.611040 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.611259 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.611260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.611260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.611391 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.611731 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.611737 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.611889 (+ 152us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.612423 (+ 534us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.612596 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260929 22:55:10.613303 7641 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:10.613430 7641 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.613605 7641 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.614049 6669 ts_manager.cc:194] Re-registered known tserver with Master: 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:10.614503 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:58473
I20260929 22:55:10.615613 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.601138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:60271 (local address 127.0.124.188:46219)
0929 22:55:10.601243 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.601245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.601397 (+ 152us) server_negotiation.cc:407] Connection header received
0929 22:55:10.601739 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.601740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.601752 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.601799 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.602902 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.603604 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.608820 (+ 5216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.609184 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.609241 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.611390 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.611391 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.611391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.611398 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.613740 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.614842 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.614843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.614843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.614903 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.615107 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.615108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.615108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.615224 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.615299 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.615440 (+ 141us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.615522 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":55,"threads_started":1}
I20260929 22:55:10.615624 7645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.601066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.124.129:60271)
0929 22:55:10.601186 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.601197 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.601646 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.602312 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.602313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.602522 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.602789 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.602796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.603932 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.603933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.608705 (+ 4772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.608707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.609321 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.609322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.609391 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.609724 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.609730 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.611292 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.613829 (+ 2537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.613830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.613830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.614763 (+ 933us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.614976 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.614977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.614978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.615034 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.615290 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.615290 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.615331 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.615415 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.615520 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":3850,"thread_start_us":68,"threads_started":1}
I20260929 22:55:10.616080 7640 heartbeater.cc:347] Connected to a master server at 127.0.124.188:46219
I20260929 22:55:10.616127 7640 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.616199 7640 heartbeater.cc:511] Master 127.0.124.188:46219 requested a full tablet report, sending...
I20260929 22:55:10.616583 7460 ts_manager.cc:194] Registered new tserver with Master: 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:10.617373 7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.601229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.124.129:45037)
0929 22:55:10.601322 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.601331 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.601646 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.608002 (+ 6356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.608002 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.608702 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.608784 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.608787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.610757 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.610758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.611557 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.611559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.612110 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.612110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.612180 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.612753 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.612759 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.614254 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.616254 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.616255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.616255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.616481 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.616728 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.616729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.616729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.616793 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.617048 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.617048 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.617087 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.617147 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.617254 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":56,"threads_started":1}
I20260929 22:55:10.617375 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.601278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:45037 (local address 127.0.124.189:42123)
0929 22:55:10.601320 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.601322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.601390 (+ 68us) server_negotiation.cc:407] Connection header received
0929 22:55:10.601737 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.601738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.601751 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.601799 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.609247 (+ 7448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.609927 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.611666 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.611958 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.612032 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.614342 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.614344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.614344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.614352 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.616118 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.616565 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.616566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.616567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.616628 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.616852 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.616853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.616854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.616971 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.617056 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.617193 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.617266 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:10.617647 7642 heartbeater.cc:347] Connected to a master server at 127.0.124.189:42123
I20260929 22:55:10.617692 7642 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.617738 7642 heartbeater.cc:511] Master 127.0.124.189:42123 requested a full tablet report, sending...
I20260929 22:55:10.618044 7274 ts_manager.cc:194] Registered new tserver with Master: 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
W20260929 22:55:10.692561 7648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:10.692794 7648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:10.692831 7648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:10.694021 7648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:10.694093 7648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:10.694137 7648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:10.695613 7648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:46841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=37533
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:10.695900 7648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:10.696141 7648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.702138 7653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.702148 7656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.702175 7654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.702491 7648 server_base.cc:1034] running on GCE node
I20260929 22:55:10.702665 7648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.702864 7648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.704056 7648 hybrid_clock.cc:648] HybridClock initialized: now 1790722510704030 us; error 31 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.706948 7648 init.cc:377] Logged in from keytab as oryx/127.0.124.130@KRBTEST.COM (short username oryx)
I20260929 22:55:10.707389 7648 webserver.cc:460] Webserver started at http://127.0.124.130:37533/ using document root <none> and password file <none>
I20260929 22:55:10.707671 7648 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.707757 7648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.709347 7648 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:10.709995 7663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.710170 7648 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:10.710273 7648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "33c2728acb7242c78a7f27de2788575a"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "17c0f2a5d0c094ff35536fbc02b78db8"
server_key_iv: "093c847321a7ce9a4560212013c2423b"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.710657 7648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.727356 7648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.729969 7648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:10.730146 7648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.730373 7648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:10.730690 7648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:10.730748 7648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.730793 7648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:10.730839 7648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.737293 7648 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:46841
I20260929 22:55:10.737330 7776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:46841 every 8 connection(s)
I20260929 22:55:10.737787 7648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:10.744725 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7648
I20260929 22:55:10.744901 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7004
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:10.749625 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.739319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:38199 (local address 127.0.124.189:42123)
0929 22:55:10.739369 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.739371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.739446 (+ 75us) server_negotiation.cc:407] Connection header received
0929 22:55:10.740246 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.740248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.740259 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.740314 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.740954 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741724 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.742840 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.743131 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.743198 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.746562 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.746563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.746563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.746571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.748059 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.748592 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.748593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.748594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.748648 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.748904 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.748905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.748906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.749020 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.749094 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.749390 (+ 296us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.749480 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:55:10.749876 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.738799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:46773 (local address 127.0.124.188:46219)
0929 22:55:10.738840 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.738842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.738853 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:55:10.740088 (+ 1235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.740090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.740106 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.740164 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.740957 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741497 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.742555 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.742858 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.742938 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.746170 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.746172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.746172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.746181 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.748560 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.749013 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.749014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.749015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.749077 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.749289 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.749290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.749291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.749420 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.749492 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.749681 (+ 189us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.749781 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:10.750176 7781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.738509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.124.130:46773)
0929 22:55:10.738692 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.738737 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.739951 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.740257 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.740262 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.740643 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.740844 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.740848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741607 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.741608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.742452 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.742454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.742940 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.742941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.743088 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.743647 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.743658 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.746076 (+ 2418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.748665 (+ 2589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.748666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.748667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.748917 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.749153 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.749153 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.749154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.749214 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.749519 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.749519 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.749555 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.749952 (+ 397us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.750048 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260929 22:55:10.750191 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.739248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.124.130:38199)
0929 22:55:10.739371 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.739380 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.739969 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.740319 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.740319 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.740712 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.740846 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.740852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741813 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.741814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.742734 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.742736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.743253 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.743254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.743317 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.743721 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.743725 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.746443 (+ 2718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.748160 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.748166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.748168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.748508 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.748715 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.748716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.748716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.748827 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.749086 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.749091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.749221 (+ 130us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.749341 (+ 120us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.749503 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":32,"thread_start_us":65,"threads_started":1}
I20260929 22:55:10.751016 7777 heartbeater.cc:347] Connected to a master server at 127.0.124.188:46219
I20260929 22:55:10.751122 7777 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.751185 7779 heartbeater.cc:347] Connected to a master server at 127.0.124.189:42123
I20260929 22:55:10.751222 7779 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.751317 7779 heartbeater.cc:511] Master 127.0.124.189:42123 requested a full tablet report, sending...
I20260929 22:55:10.751317 7777 heartbeater.cc:511] Master 127.0.124.188:46219 requested a full tablet report, sending...
I20260929 22:55:10.751765 7274 ts_manager.cc:194] Registered new tserver with Master: 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841)
I20260929 22:55:10.751847 7460 ts_manager.cc:194] Registered new tserver with Master: 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841)
I20260929 22:55:10.752965 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:39553
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:40095
--webserver_port=42001
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:55:10.755602 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.738743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55659 (local address 127.0.124.190:40095)
0929 22:55:10.738821 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.738823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.738989 (+ 166us) server_negotiation.cc:407] Connection header received
0929 22:55:10.740138 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.740140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.740157 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.740250 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.740952 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741730 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.742816 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.743085 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.743167 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.752674 (+ 9507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.752675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.752675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.752683 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.754439 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.754794 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.754795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.754796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.754859 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.755068 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.755069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.755069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.755193 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.755277 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.755455 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.755544 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:55:10.755666 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.738509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:55659)
0929 22:55:10.738907 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.738917 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.739966 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.740257 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.740261 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.740713 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.740846 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.740852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.741813 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.741814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.742735 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.742736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.743185 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.743186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.743256 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.743906 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.743912 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.746836 (+ 2924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.754524 (+ 7688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.754525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.754526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.754700 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.754936 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.754937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.754938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.755000 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.755267 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.755268 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.755310 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.755392 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.755503 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":90,"thread_start_us":115,"threads_started":1}
I20260929 22:55:10.756026 7778 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:10.756093 7778 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.756163 7778 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
I20260929 22:55:10.756435 6669 ts_manager.cc:194] Re-registered known tserver with Master: 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841)
I20260929 22:55:10.757032 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:55659
W20260929 22:55:10.835618 7784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:10.835840 7784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:10.835867 7784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:10.836975 7784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:10.837013 7784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:10.837062 7784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:10.838454 7784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:39553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=42001
--tserver_master_addrs=127.0.124.190:40095,127.0.124.189:42123,127.0.124.188:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:10.838703 7784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:10.838932 7784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:10.843641 7789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.843849 7784 server_base.cc:1034] running on GCE node
W20260929 22:55:10.843647 7792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:10.843657 7790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:10.844147 7784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:10.844412 7784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:10.845603 7784 hybrid_clock.cc:648] HybridClock initialized: now 1790722510845588 us; error 25 us; skew 500 ppm
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:10.848078 7784 init.cc:377] Logged in from keytab as oryx/127.0.124.131@KRBTEST.COM (short username oryx)
I20260929 22:55:10.848591 7784 webserver.cc:460] Webserver started at http://127.0.124.131:42001/ using document root <none> and password file <none>
I20260929 22:55:10.848846 7784 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:10.848923 7784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:10.850260 7784 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:10.851050 7799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.851255 7784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:10.851369 7784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "46005e38018f486c84c8b2722d083cd6"
format_stamp: "Formatted at 2026-09-29 22:55:09 on dist-test-slave-512q"
server_key: "8b270236e52a04e4e45c576ac3e3069c"
server_key_iv: "ede9350ee648975d0b983e5321e6c3e7"
server_key_version: "encryptionkey@0"
I20260929 22:55:10.851717 7784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:10.855276 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.852293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35992 (local address 127.0.124.188:46219)
0929 22:55:10.852337 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.852339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.852359 (+ 20us) server_negotiation.cc:407] Connection header received
0929 22:55:10.852390 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.852391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.852409 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.852460 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:10.852638 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.853127 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.854547 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.854948 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.855037 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.855077 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.855203 (+ 126us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.855228 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:10.855334 7233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.852044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.0.1:35992)
0929 22:55:10.852116 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.852128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.852181 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.852496 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.852498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.852501 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:10.852557 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.852559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.853203 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.853204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.854432 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.854436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.855041 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.855043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.855115 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.855120 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.855201 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.855251 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260929 22:55:10.855636 7468 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260929 22:55:10.855805 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 356f9818428a4b799a41e354aa6841ad. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.855937 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:55:10.876675 7784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:10.878667 7784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:10.878805 7784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:10.879024 7784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:10.879325 7784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:10.879362 7784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.879396 7784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:10.879417 7784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:10.885974 7784 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:39553
I20260929 22:55:10.886016 7912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:39553 every 8 connection(s)
I20260929 22:55:10.886382 7784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:10.889098 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 7784
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.188@KRBTEST.COM
I20260929 22:55:10.900157 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.890719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35996 (local address 127.0.124.188:46219)
0929 22:55:10.890843 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.890844 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.891501 (+ 657us) server_negotiation.cc:407] Connection header received
0929 22:55:10.891533 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.891533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.891548 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.891636 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.892331 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.893055 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.894069 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.894360 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.894420 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.895906 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.895907 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.895907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.895914 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.898643 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.899015 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.899016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.899016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.899070 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.899256 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.899258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.899258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.899415 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.899524 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.899940 (+ 416us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.900038 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":72,"threads_started":1}
I20260929 22:55:10.900411 7924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.890380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51824 (local address 127.0.124.189:42123)
0929 22:55:10.890634 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.890637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.891016 (+ 379us) server_negotiation.cc:407] Connection header received
0929 22:55:10.891084 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.891084 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.891096 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.891159 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.892086 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.892784 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.893878 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.894178 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.894247 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.896145 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.896147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.896147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.896155 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.898880 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.899315 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.899316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.899316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.899373 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.899587 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.899588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.899588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.899716 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.899809 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.900189 (+ 380us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.900301 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":47,"threads_started":1}
Sep 29 22:55:10 dist-test-slave-512q krb5kdc[6624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722510, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.189@KRBTEST.COM
I20260929 22:55:10.902640 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:38245 (local address 127.0.124.188:46219)
0929 22:55:10.887448 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.887450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.887458 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:10.888694 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.888696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.888711 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.888763 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.889529 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.890260 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.893625 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.893916 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.893968 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.896720 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.896721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.896721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.896729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.899919 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901483 (+ 1564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.901485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.901485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.901550 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901885 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.901886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.901887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.902006 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.902071 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.902480 (+ 409us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.902555 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:55:10.902794 7918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:37391)
0929 22:55:10.887316 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.887341 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.888448 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.888706 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.888710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.889132 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.889405 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.889409 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.890279 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.890280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.891646 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.891648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.892144 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.892145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.892305 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.892850 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.892860 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.894709 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.899143 (+ 4434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.899149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.899152 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.901136 (+ 1984us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.901631 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.901632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.901791 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.902112 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.902113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.902263 (+ 150us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.902388 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.902561 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":83,"thread_start_us":92,"threads_started":1}
I20260929 22:55:10.902963 7917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.124.131:38245)
0929 22:55:10.887299 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.887339 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.888463 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.888782 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.888782 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.889150 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.889406 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.889415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.890361 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.890362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.893543 (+ 3181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.893545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.894019 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.894020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.894087 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.894968 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.894973 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.896630 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.900025 (+ 3395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.900026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.900026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.901396 (+ 1370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.901631 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.901632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.901791 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.902101 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.902107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.902263 (+ 156us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.902387 (+ 124us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.902835 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":1470,"thread_start_us":114,"threads_started":1}
I20260929 22:55:10.903138 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:37391 (local address 127.0.124.190:40095)
0929 22:55:10.887178 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.887181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.887423 (+ 242us) server_negotiation.cc:407] Connection header received
0929 22:55:10.888561 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.888563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.888574 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.888636 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.889500 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.890168 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.891715 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.892011 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.892079 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.894810 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.894811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.894812 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.894820 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.899051 (+ 4231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901492 (+ 2441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.901493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.901494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.901550 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.901876 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.901877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.901877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.902006 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.902071 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.902937 (+ 866us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.903030 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:55:10.903611 7914 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40095
I20260929 22:55:10.903730 7914 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.903875 7913 heartbeater.cc:347] Connected to a master server at 127.0.124.188:46219
I20260929 22:55:10.903941 7914 heartbeater.cc:511] Master 127.0.124.190:40095 requested a full tablet report, sending...
I20260929 22:55:10.903932 7913 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.904203 7913 heartbeater.cc:511] Master 127.0.124.188:46219 requested a full tablet report, sending...
I20260929 22:55:10.904381 6669 ts_manager.cc:194] Re-registered known tserver with Master: 46005e38018f486c84c8b2722d083cd6 (127.0.124.131:39553)
I20260929 22:55:10.904670 7460 ts_manager.cc:194] Registered new tserver with Master: 46005e38018f486c84c8b2722d083cd6 (127.0.124.131:39553)
I20260929 22:55:10.904871 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:37391
I20260929 22:55:10.905542 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:38063 (local address 127.0.124.189:42123)
0929 22:55:10.887639 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.887641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.887652 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:55:10.888813 (+ 1161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.888814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.888824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.888876 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.892261 (+ 3385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.893234 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.896539 (+ 3305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.896840 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.896917 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.902367 (+ 5450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.902368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.902368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.902375 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.904035 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.904644 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.904645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.904645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.904706 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.904955 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.904955 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.904956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.905083 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.905136 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.905378 (+ 242us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.905457 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:10.905722 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.887446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.124.131:38063)
0929 22:55:10.887553 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.887562 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.888463 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.888894 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.890099 (+ 1205us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.890886 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:10.890979 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.890981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.895557 (+ 4576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.895558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.896447 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.896450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.896973 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.896975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.897041 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.897797 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:10.898016 (+ 219us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:10.902259 (+ 4243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:10.904345 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.904346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.904347 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.904560 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.904780 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:10.904781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:10.904782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:10.904877 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:10.905170 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:10.905171 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:10.905234 (+ 63us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.905297 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.905434 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":39,"thread_start_us":69,"threads_started":1}
I20260929 22:55:10.906020 7915 heartbeater.cc:347] Connected to a master server at 127.0.124.189:42123
I20260929 22:55:10.906071 7915 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:10.906139 7915 heartbeater.cc:511] Master 127.0.124.189:42123 requested a full tablet report, sending...
I20260929 22:55:10.906414 7274 ts_manager.cc:194] Registered new tserver with Master: 46005e38018f486c84c8b2722d083cd6 (127.0.124.131:39553)
I20260929 22:55:10.906744 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.891228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58346 (local address 127.0.124.190:40095)
0929 22:55:10.894581 (+ 3353us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.894583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.896429 (+ 1846us) server_negotiation.cc:407] Connection header received
0929 22:55:10.896450 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.896451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.896464 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.896525 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:10.897390 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.898205 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.899220 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.899549 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.899613 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.902097 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:10.902098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:10.902098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:10.902106 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:10.905434 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.905975 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.905977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.905977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.906036 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:10.906228 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:10.906228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:10.906229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:10.906345 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:10.906467 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.906584 (+ 117us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.906672 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3319,"thread_start_us":78,"threads_started":1}
I20260929 22:55:10.908097 6669 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:10.909740 6669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:10.910526 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: NON_VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: true } } }
I20260929 22:55:10.910641 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.911782 7235 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: attempting to promote NON_VOTER 072ebd1186bc446ba3f04198e84e6e73 to VOTER
I20260929 22:55:10.911909 7235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } }
I20260929 22:55:10.912377 7468 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 LEARNER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260929 22:55:10.912564 7284 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Refusing update from remote peer 356f9818428a4b799a41e354aa6841ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260929 22:55:10.912555 7423 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260929 22:55:10.912781 7423 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260929 22:55:10.913230 7236 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.913451 7468 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914099 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914083 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914194 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.914299 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914371 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.914184 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:10.914628 7284 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914698 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.914773 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:55:10.915812 7314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "356f9818428a4b799a41e354aa6841ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:10.915930 7314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:55:10.919556 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.915544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:36595 (local address 127.0.0.1:52346)
0929 22:55:10.915912 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.915923 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.915973 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.916426 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.916426 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.916428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:10.916460 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.916461 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917671 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.917672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.918362 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.918363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919313 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.919379 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.919384 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.919430 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.919474 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":80,"threads_started":1}
I20260929 22:55:10.919706 7233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.915522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:39553 (local address 127.0.0.1:48028)
0929 22:55:10.915744 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.915756 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.915820 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.916161 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.916162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.916163 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:10.916222 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.916224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917526 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.917527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.918588 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.918590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919497 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.919554 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.919557 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.919606 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.919645 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260929 22:55:10.919853 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.915761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.0.124.129:36595)
0929 22:55:10.916189 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.916194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.916233 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:55:10.916272 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.916275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.916292 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.916362 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:10.916549 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917574 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.918447 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919139 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919209 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.919279 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.919707 (+ 428us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.919756 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260929 22:55:10.919961 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.915596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.0.124.131:39553)
0929 22:55:10.915733 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.915737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.915799 (+ 62us) server_negotiation.cc:407] Connection header received
0929 22:55:10.916013 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.916016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.916035 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.916112 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:10.916343 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917422 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.918670 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919339 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919398 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.919467 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.919844 (+ 377us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.919886 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260929 22:55:10.920281 7940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.915625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46841 (local address 127.0.0.1:45486)
0929 22:55:10.916151 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:10.916163 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:10.916266 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:10.916772 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:10.916773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:10.916775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:10.916816 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.916818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917987 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.917988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.918943 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:10.918945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919996 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:10.920068 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.920074 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 22:55:10.920137 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:55:10.920179 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":80,"threads_started":1}
I20260929 22:55:10.920578 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:10.916012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.0.124.130:46841)
0929 22:55:10.916198 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:10.916202 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:10.916264 (+ 62us) server_negotiation.cc:407] Connection header received
0929 22:55:10.916364 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:10.916366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:10.916383 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:10.916443 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:10.916946 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.917885 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919033 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:10.919798 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:10.919878 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:10.919960 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:10.920447 (+ 487us) server_negotiation.cc:299] Negotiation successful
0929 22:55:10.920492 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":77,"threads_started":1}
I20260929 22:55:10.920584 7847 tablet_service.cc:1467] Processing CreateTablet for tablet 82f3a89ee0674cac89e2a6486af85314 (DEFAULT_TABLE table=test-table [id=82322c4f7476433b8cf5ab0d8b7134bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:10.920675 7574 tablet_service.cc:1467] Processing CreateTablet for tablet 82f3a89ee0674cac89e2a6486af85314 (DEFAULT_TABLE table=test-table [id=82322c4f7476433b8cf5ab0d8b7134bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:10.920940 7847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f3a89ee0674cac89e2a6486af85314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:10.921030 7574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f3a89ee0674cac89e2a6486af85314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:10.921115 7711 tablet_service.cc:1467] Processing CreateTablet for tablet 82f3a89ee0674cac89e2a6486af85314 (DEFAULT_TABLE table=test-table [id=82322c4f7476433b8cf5ab0d8b7134bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:10.921468 7711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f3a89ee0674cac89e2a6486af85314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:10.923759 7943 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Bootstrap starting.
I20260929 22:55:10.924463 7943 tablet_bootstrap.cc:654] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:10.924592 7944 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Bootstrap starting.
I20260929 22:55:10.924918 7943 log.cc:824] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:10.924949 7945 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Bootstrap starting.
I20260929 22:55:10.925203 7944 tablet_bootstrap.cc:654] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:10.925542 7944 log.cc:824] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:10.925596 7945 tablet_bootstrap.cc:654] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:10.925855 7943 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: No bootstrap required, opened a new log
I20260929 22:55:10.925911 7945 log.cc:824] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:10.925938 7943 ts_tablet_manager.cc:1397] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:10.926306 7944 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: No bootstrap required, opened a new log
I20260929 22:55:10.926373 7944 ts_tablet_manager.cc:1397] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:10.926669 7945 tablet_bootstrap.cc:492] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: No bootstrap required, opened a new log
I20260929 22:55:10.926761 7945 ts_tablet_manager.cc:1397] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:10.928073 7943 raft_consensus.cc:348] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.928337 7943 raft_consensus.cc:374] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:10.928347 7944 raft_consensus.cc:348] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.928411 7943 raft_consensus.cc:729] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2925b69964ad99ac5b3800905c319, State: Initialized, Role: FOLLOWER
I20260929 22:55:10.928519 7944 raft_consensus.cc:374] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:10.928563 7944 raft_consensus.cc:729] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46005e38018f486c84c8b2722d083cd6, State: Initialized, Role: FOLLOWER
I20260929 22:55:10.928619 7943 consensus_queue.cc:260] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.928674 7944 consensus_queue.cc:260] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.928957 7944 ts_tablet_manager.cc:1428] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:55:10.928956 7914 heartbeater.cc:503] Master 127.0.124.190:40095 was elected leader, sending a full tablet report...
I20260929 22:55:10.928897 7943 ts_tablet_manager.cc:1428] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:55:10.929288 7641 heartbeater.cc:503] Master 127.0.124.190:40095 was elected leader, sending a full tablet report...
I20260929 22:55:10.930689 7945 raft_consensus.cc:348] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.930877 7945 raft_consensus.cc:374] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:10.930932 7945 raft_consensus.cc:729] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2728acb7242c78a7f27de2788575a, State: Initialized, Role: FOLLOWER
I20260929 22:55:10.931056 7945 consensus_queue.cc:260] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:10.931245 7945 ts_tablet_manager.cc:1428] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260929 22:55:10.931311 7778 heartbeater.cc:503] Master 127.0.124.190:40095 was elected leader, sending a full tablet report...
W20260929 22:55:10.989463 7780 tablet.cc:2369] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:55:11.101089 7643 tablet.cc:2369] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:55:11.137266 7916 tablet.cc:2369] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:11.162647 7950 raft_consensus.cc:482] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:11.162767 7950 raft_consensus.cc:504] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:11.163064 7950 leader_election.cc:288] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841), 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:11.167081 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.163357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:59069 (local address 127.0.124.130:46841)
0929 22:55:11.163440 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.163442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.163454 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:55:11.163483 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.163485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.163493 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.163594 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:11.163823 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.164639 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166150 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.166705 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166793 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.166801 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.166974 (+ 173us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.167014 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260929 22:55:11.167081 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.163408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:47415 (local address 127.0.124.129:36595)
0929 22:55:11.163452 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.163454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.163464 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:11.163550 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.163550 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.163559 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.163613 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:11.163826 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.164588 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166150 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.166698 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166793 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.166801 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.166974 (+ 173us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.167017 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:55:11.167083 7917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.163273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:36595 (local address 127.0.124.131:47415)
0929 22:55:11.163424 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:11.163434 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:11.163467 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:11.163632 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:11.163633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:11.163634 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:11.163744 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:11.163747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.164688 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.164689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:11.166032 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:11.166035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.166804 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166804 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:11.166881 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.166885 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:11.166941 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:55:11.166985 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":170}
I20260929 22:55:11.167092 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.163273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46841 (local address 127.0.124.131:59069)
0929 22:55:11.163344 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:11.163356 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:11.163403 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:11.163632 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:11.163633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:11.163634 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:11.163750 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:11.163751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.164710 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.164711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:11.166032 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:11.166035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.166804 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.166804 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:11.166887 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.166889 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:11.166941 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:55:11.166995 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":98}
I20260929 22:55:11.167462 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f3a89ee0674cac89e2a6486af85314" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2925b69964ad99ac5b3800905c319" is_pre_election: true
I20260929 22:55:11.167465 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f3a89ee0674cac89e2a6486af85314" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2728acb7242c78a7f27de2788575a" is_pre_election: true
I20260929 22:55:11.167622 7731 raft_consensus.cc:2454] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 0.
I20260929 22:55:11.167622 7594 raft_consensus.cc:2454] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 0.
I20260929 22:55:11.167845 7801 leader_election.cc:302] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2728acb7242c78a7f27de2788575a, 46005e38018f486c84c8b2722d083cd6; no voters:
I20260929 22:55:11.168027 7950 raft_consensus.cc:2781] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:11.168069 7950 raft_consensus.cc:482] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:11.168084 7950 raft_consensus.cc:3037] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:11.168798 7950 raft_consensus.cc:504] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:11.168937 7950 leader_election.cc:288] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 election: Requested vote from peers 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841), 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:11.169109 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f3a89ee0674cac89e2a6486af85314" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2728acb7242c78a7f27de2788575a"
I20260929 22:55:11.169100 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f3a89ee0674cac89e2a6486af85314" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2925b69964ad99ac5b3800905c319"
I20260929 22:55:11.169174 7731 raft_consensus.cc:3037] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:11.169174 7594 raft_consensus.cc:3037] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:11.169955 7731 raft_consensus.cc:2454] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 1.
I20260929 22:55:11.169955 7594 raft_consensus.cc:2454] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 1.
I20260929 22:55:11.170136 7801 leader_election.cc:302] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2728acb7242c78a7f27de2788575a, 46005e38018f486c84c8b2722d083cd6; no voters:
I20260929 22:55:11.170264 7950 raft_consensus.cc:2781] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:11.170454 7950 raft_consensus.cc:686] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 1 LEADER]: Becoming Leader. State: Replica: 46005e38018f486c84c8b2722d083cd6, State: Running, Role: LEADER
I20260929 22:55:11.170554 7950 consensus_queue.cc:237] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:11.171306 6669 catalog_manager.cc:5495] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46005e38018f486c84c8b2722d083cd6 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "46005e38018f486c84c8b2722d083cd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:11.199384 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.197050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.0.124.131:39553)
0929 22:55:11.197109 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.197111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.197119 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:11.197171 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.197172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.197188 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.197247 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:11.197375 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.197861 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.198644 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.198823 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.198873 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.199040 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:11.199133 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:11.199193 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.199280 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.199302 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:55:11.201095 7594 raft_consensus.cc:1261] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Refusing update from remote peer 46005e38018f486c84c8b2722d083cd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:11.201123 7731 raft_consensus.cc:1261] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Refusing update from remote peer 46005e38018f486c84c8b2722d083cd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:11.201463 7952 consensus_queue.cc:1035] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:11.201583 7950 consensus_queue.cc:1035] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:11.204584 7956 mvcc.cc:205] Tried to move back new op lower bound from 7334799405877104640 to 7334799405755060224. Current Snapshot: MvccSnapshot[applied={T|T < 7334799405877104640}]
I20260929 22:55:11.206712 6668 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:11.206806 6668 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:11.208266 6668 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 356f9818428a4b799a41e354aa6841ad: Sending DeleteTablet for 3 replicas of tablet 82f3a89ee0674cac89e2a6486af85314
I20260929 22:55:11.208586 7847 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f3a89ee0674cac89e2a6486af85314 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:11 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:48028
I20260929 22:55:11.208657 7574 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f3a89ee0674cac89e2a6486af85314 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:11 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:52346
I20260929 22:55:11.208799 7965 tablet_replica.cc:330] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: stopping tablet replica
I20260929 22:55:11.208884 7965 raft_consensus.cc:2229] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:11.208880 7711 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f3a89ee0674cac89e2a6486af85314 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:11 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:45486
I20260929 22:55:11.208978 7965 raft_consensus.cc:2258] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:11.209406 7965 ts_tablet_manager.cc:1905] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:11.210210 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 6637
I20260929 22:55:11.211203 7965 ts_tablet_manager.cc:1918] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:11.211275 7965 log.cc:1196] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/82f3a89ee0674cac89e2a6486af85314
I20260929 22:55:11.211547 7965 ts_tablet_manager.cc:1939] T 82f3a89ee0674cac89e2a6486af85314 P 46005e38018f486c84c8b2722d083cd6: Deleting consensus metadata
I20260929 22:55:11.216521 7966 tablet_replica.cc:330] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: stopping tablet replica
I20260929 22:55:11.216651 7966 raft_consensus.cc:2229] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:11.216766 7966 raft_consensus.cc:2258] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 22:55:11.217067 7801 connection.cc:535] server connection from 127.0.0.1:48028 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:55:11.216924 7967 tablet_replica.cc:330] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: stopping tablet replica
I20260929 22:55:11.217281 7967 raft_consensus.cc:2229] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:11.217296 7966 ts_tablet_manager.cc:1905] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:11.217564 7967 raft_consensus.cc:2258] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:11.218079 7967 ts_tablet_manager.cc:1905] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:11.218910 7966 ts_tablet_manager.cc:1918] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:11.218981 7966 log.cc:1196] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/82f3a89ee0674cac89e2a6486af85314
I20260929 22:55:11.219252 7966 ts_tablet_manager.cc:1939] T 82f3a89ee0674cac89e2a6486af85314 P 27e2925b69964ad99ac5b3800905c319: Deleting consensus metadata
W20260929 22:55:11.219620 7527 connection.cc:441] server connection from 127.0.0.1:52346 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52346 (request call id 1) could send its response
I20260929 22:55:11.219856 7967 ts_tablet_manager.cc:1918] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:11.219930 7967 log.cc:1196] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/82f3a89ee0674cac89e2a6486af85314
I20260929 22:55:11.220252 7967 ts_tablet_manager.cc:1939] T 82f3a89ee0674cac89e2a6486af85314 P 33c2728acb7242c78a7f27de2788575a: Deleting consensus metadata
W20260929 22:55:11.220592 7665 connection.cc:441] server connection from 127.0.0.1:45486 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45486 (request call id 1) could send its response
I20260929 22:55:11.225042 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.209563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.0.124.188:46219)
0929 22:55:11.209615 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.209617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.216413 (+ 6796us) server_negotiation.cc:407] Connection header received
0929 22:55:11.216473 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.216474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.216487 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.216539 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:11.217473 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.218193 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.219239 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.219533 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.219578 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.221495 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:11.221497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:11.221497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:11.221505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:11.223282 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.223689 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.223690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.223690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.223744 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.224452 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.224453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.224454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.224593 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:11.224715 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.224858 (+ 143us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.224949 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:55:11.228509 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.219614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36002 (local address 127.0.124.188:46219)
0929 22:55:11.219731 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.219732 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.220791 (+ 1059us) server_negotiation.cc:407] Connection header received
0929 22:55:11.220898 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.220899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.220913 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.220946 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:11.221766 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.222484 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.223455 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.223743 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.223785 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.225654 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:11.225656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:11.225656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:11.225663 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:11.227144 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.227515 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.227516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.227516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.227568 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.227987 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.227987 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.227988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.228117 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:11.228235 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.228336 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.228413 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260929 22:55:11.228812 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:11.219256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.0.124.189:42123)
0929 22:55:11.219302 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:11.219304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:11.220248 (+ 944us) server_negotiation.cc:407] Connection header received
0929 22:55:11.220403 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:11.220404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:11.220415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:11.220445 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:11.221443 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.222205 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.223256 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:11.223541 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:11.223578 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:11.225667 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:11.225668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:11.225668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:11.225676 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:11.227561 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.227910 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.227911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.227912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.227975 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:11.228146 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:11.228147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:11.228147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:11.228354 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:11.228523 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:11.228643 (+ 120us) server_negotiation.cc:299] Negotiation successful
0929 22:55:11.228720 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:12.205674 7976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.205373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:56243)
0929 22:55:12.205529 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.205615 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":63,"threads_started":1}
W20260929 22:55:12.205978 7641 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:40095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.206897 7977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.206689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:55921)
0929 22:55:12.206790 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.206856 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":55,"threads_started":1}
W20260929 22:55:12.207127 7914 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:40095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.207527 7978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.207366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:54603)
0929 22:55:12.207446 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.207495 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68,"thread_start_us":39,"threads_started":1}
W20260929 22:55:12.207723 7778 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:40095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.708662 7979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 356f9818428a4b799a41e354aa6841ad)
I20260929 22:55:12.708877 7980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 356f9818428a4b799a41e354aa6841ad)
I20260929 22:55:12.709033 7980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } }
I20260929 22:55:12.709050 7979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } }
I20260929 22:55:12.709313 7980 leader_election.cc:288] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095), 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189:42123)
I20260929 22:55:12.709324 7979 leader_election.cc:288] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095), 072ebd1186bc446ba3f04198e84e6e73 (127.0.124.188:46219)
I20260929 22:55:12.709841 7981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58868)
0929 22:55:12.709745 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.709804 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":54,"threads_started":1}
W20260929 22:55:12.709949 7259 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.710071 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58870)
0929 22:55:12.709817 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.709863 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":53,"threads_started":1}
W20260929 22:55:12.710207 7445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.710549 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.710362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58892)
0929 22:55:12.710488 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.710522 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260929 22:55:12.710628 7259 leader_election.cc:334] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095): Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.710958 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.710856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58894)
0929 22:55:12.710907 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.710935 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260929 22:55:12.711031 7445 leader_election.cc:334] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095): Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.713033 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:42123 (local address 127.0.0.1:51842)
0929 22:55:12.709972 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.709982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:12.710044 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:12.710257 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:12.710258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:12.710260 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:12.710314 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.710316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.711226 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.711227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.711968 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.711970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.712777 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.712846 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.712849 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:12.712894 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:55:12.712961 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":65,"threads_started":1}
I20260929 22:55:12.713053 7986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51842 (local address 127.0.124.189:42123)
0929 22:55:12.709937 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.709939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.710099 (+ 160us) server_negotiation.cc:407] Connection header received
0929 22:55:12.710140 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.710141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.710151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.710207 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:12.710393 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.711158 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712081 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.712661 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712740 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.712752 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.712916 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.712960 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70,"thread_start_us":42,"threads_started":1}
I20260929 22:55:12.713093 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36004 (local address 127.0.124.188:46219)
0929 22:55:12.710015 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.710017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.710326 (+ 309us) server_negotiation.cc:407] Connection header received
0929 22:55:12.710434 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.710435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.710445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.710512 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:12.710664 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.711333 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712183 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.712723 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712781 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.712789 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.712969 (+ 180us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.713006 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":38,"threads_started":1}
I20260929 22:55:12.713248 7284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "072ebd1186bc446ba3f04198e84e6e73" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c339ac21f6f42cfbc41525af36d1f39" is_pre_election: true
I20260929 22:55:12.713371 7284 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 072ebd1186bc446ba3f04198e84e6e73 in term 1.
I20260929 22:55:12.713053 7981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.709652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:46219 (local address 127.0.0.1:36004)
0929 22:55:12.710267 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.710277 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:12.710352 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:12.710513 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:12.710513 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:12.710520 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:12.710561 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.710562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.711408 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.711408 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.712115 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.712117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.712816 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.712817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.712867 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.712870 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:12.712944 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:55:12.712975 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":54,"threads_started":1}
I20260929 22:55:12.713511 7446 leader_election.cc:302] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 072ebd1186bc446ba3f04198e84e6e73, 4c339ac21f6f42cfbc41525af36d1f39; no voters: 356f9818428a4b799a41e354aa6841ad
I20260929 22:55:12.713620 7980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 22:55:12.713649 7980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 356f9818428a4b799a41e354aa6841ad)
I20260929 22:55:12.713666 7980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:55:12.713747 7468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c339ac21f6f42cfbc41525af36d1f39" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "072ebd1186bc446ba3f04198e84e6e73" is_pre_election: true
I20260929 22:55:12.714373 7980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } }
I20260929 22:55:12.714555 7980 leader_election.cc:288] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 election: Requested vote from peers 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095), 4c339ac21f6f42cfbc41525af36d1f39 (127.0.124.189:42123)
I20260929 22:55:12.714564 7468 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c339ac21f6f42cfbc41525af36d1f39 in current term 2: Already voted for candidate 072ebd1186bc446ba3f04198e84e6e73 in this term.
I20260929 22:55:12.714691 7284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "072ebd1186bc446ba3f04198e84e6e73" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c339ac21f6f42cfbc41525af36d1f39"
I20260929 22:55:12.714756 7284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:55:12.714772 7260 leader_election.cc:302] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c339ac21f6f42cfbc41525af36d1f39; no voters: 072ebd1186bc446ba3f04198e84e6e73, 356f9818428a4b799a41e354aa6841ad
I20260929 22:55:12.715338 7284 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 072ebd1186bc446ba3f04198e84e6e73 in term 2.
I20260929 22:55:12.715456 7979 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:55:12.715517 7446 leader_election.cc:302] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 072ebd1186bc446ba3f04198e84e6e73, 4c339ac21f6f42cfbc41525af36d1f39; no voters:
I20260929 22:55:12.715529 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.714652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58908)
0929 22:55:12.715473 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.715502 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":805}
I20260929 22:55:12.715618 7980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:55:12.715729 7980 raft_consensus.cc:686] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [term 2 LEADER]: Becoming Leader. State: Replica: 072ebd1186bc446ba3f04198e84e6e73, State: Running, Role: LEADER
I20260929 22:55:12.715838 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.715736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58918)
0929 22:55:12.715790 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.715820 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 22:55:12.715802 7980 consensus_queue.cc:237] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } }
W20260929 22:55:12.715925 7445 leader_election.cc:334] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095): Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
I20260929 22:55:12.716144 7989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 072ebd1186bc446ba3f04198e84e6e73. Latest consensus state: current_term: 2 leader_uuid: "072ebd1186bc446ba3f04198e84e6e73" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:12.716256 7989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:12.716434 7991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:12.716830 7991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:12.716907 7991 catalog_manager.cc:1259] Loaded cluster ID: 82646f2b675a4d3999ef5ccec68a57ff
I20260929 22:55:12.716939 7991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:12.717098 7991 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:12.717160 7991 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Loaded TSK: 0
I20260929 22:55:12.717298 7991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:12.770093 7460 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:12.771704 7460 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:12.772930 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.772788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58942)
0929 22:55:12.772856 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.772894 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260929 22:55:12.772984 7284 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [term 2 FOLLOWER]: Refusing update from remote peer 072ebd1186bc446ba3f04198e84e6e73: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260929 22:55:12.773303 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.773178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.0.1:58954)
0929 22:55:12.773253 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.773283 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260929 22:55:12.773254 7980 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260929 22:55:12.773397 7445 consensus_peers.cc:487] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 -> Peer 356f9818428a4b799a41e354aa6841ad (127.0.124.190:40095): Couldn't send request to peer 356f9818428a4b799a41e354aa6841ad. Status: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 22:55:12.773877 7979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 072ebd1186bc446ba3f04198e84e6e73. Latest consensus state: current_term: 2 leader_uuid: "072ebd1186bc446ba3f04198e84e6e73" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:12.774003 7979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:55:12.774346 7992 mvcc.cc:205] Tried to move back new op lower bound from 7334799412315398144 to 7334799412084523008. Current Snapshot: MvccSnapshot[applied={T|T < 7334799412315398144}]
I20260929 22:55:12.774421 7989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "072ebd1186bc446ba3f04198e84e6e73" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:12.774513 7989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:12.774602 7979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "072ebd1186bc446ba3f04198e84e6e73" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "356f9818428a4b799a41e354aa6841ad" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40095 } } peers { permanent_uuid: "4c339ac21f6f42cfbc41525af36d1f39" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 42123 } attrs { promote: false } } peers { permanent_uuid: "072ebd1186bc446ba3f04198e84e6e73" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 46219 } attrs { promote: false } } }
I20260929 22:55:12.774699 7979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c339ac21f6f42cfbc41525af36d1f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:55:12.779561 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46841 (local address 127.0.0.1:45502)
0929 22:55:12.776413 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.776423 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:12.776501 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:12.776781 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:12.776782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:12.776784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:12.776836 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.776838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777771 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.777772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.778633 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.778636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779362 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.779423 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779428 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:55:12.779457 (+ 29us) client_negotiation.cc:240] Negotiation successful
0929 22:55:12.779496 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260929 22:55:12.779822 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:36595 (local address 127.0.0.1:52358)
0929 22:55:12.776588 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.776597 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:12.776635 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:12.776810 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:12.776811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:12.776814 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:12.776866 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.776867 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777691 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.777692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.778903 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.778905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779622 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.779695 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779697 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:12.779727 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 22:55:12.779764 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":71}
I20260929 22:55:12.779816 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48040 (local address 127.0.124.131:39553)
0929 22:55:12.776718 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.776720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.776892 (+ 172us) server_negotiation.cc:407] Connection header received
0929 22:55:12.776920 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.776921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.776933 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.777008 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:12.777165 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777844 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779053 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779429 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779530 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779541 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.779700 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.779746 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":59,"threads_started":1}
I20260929 22:55:12.779958 7997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.0.124.130:46841)
0929 22:55:12.776645 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.776647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.776656 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:12.776682 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.776683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.776694 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.776904 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:12.776951 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777681 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.778729 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779271 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779743 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779756 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.779776 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.779818 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":59,"threads_started":1}
I20260929 22:55:12.780062 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:39553 (local address 127.0.0.1:48040)
0929 22:55:12.776785 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.776793 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:12.776839 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:12.777049 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:12.777050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:12.777052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:12.777088 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.777090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777917 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.777918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.778980 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:12.778990 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779533 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:12.779597 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779602 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:55:12.779900 (+ 298us) client_negotiation.cc:240] Negotiation successful
0929 22:55:12.779953 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":3,"thread_start_us":75,"threads_started":1}
I20260929 22:55:12.780174 7711 tablet_service.cc:1467] Processing CreateTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 (DEFAULT_TABLE table=test-table [id=b327c7300af74894bf0b08c453609a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:12.780331 7711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4a781151394a16bdc8bfb5d7e12979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:12.780344 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.776520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52358 (local address 127.0.124.129:36595)
0929 22:55:12.776664 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.776666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.776675 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:12.776700 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.776701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.776713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.776930 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:12.777013 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.777612 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.778988 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.779549 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.779808 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.779821 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.779838 (+ 17us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.780272 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260929 22:55:12.780372 7847 tablet_service.cc:1467] Processing CreateTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 (DEFAULT_TABLE table=test-table [id=b327c7300af74894bf0b08c453609a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:12.780488 7847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4a781151394a16bdc8bfb5d7e12979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:12.780529 7574 tablet_service.cc:1467] Processing CreateTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 (DEFAULT_TABLE table=test-table [id=b327c7300af74894bf0b08c453609a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:12.780620 7574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4a781151394a16bdc8bfb5d7e12979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:12.781646 8001 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Bootstrap starting.
I20260929 22:55:12.781977 8002 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: Bootstrap starting.
I20260929 22:55:12.782189 8001 tablet_bootstrap.cc:654] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:12.782325 8002 tablet_bootstrap.cc:654] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:12.782768 8001 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: No bootstrap required, opened a new log
I20260929 22:55:12.782826 8001 ts_tablet_manager.cc:1397] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:12.782909 8003 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Bootstrap starting.
I20260929 22:55:12.782960 8001 raft_consensus.cc:348] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.783051 8001 raft_consensus.cc:374] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:12.783082 8001 raft_consensus.cc:729] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2728acb7242c78a7f27de2788575a, State: Initialized, Role: FOLLOWER
I20260929 22:55:12.783139 8001 consensus_queue.cc:260] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.783207 8002 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: No bootstrap required, opened a new log
I20260929 22:55:12.783345 8001 ts_tablet_manager.cc:1428] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:12.783358 8002 ts_tablet_manager.cc:1397] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:12.783514 8002 raft_consensus.cc:348] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.783587 8002 raft_consensus.cc:374] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:12.783613 8002 raft_consensus.cc:729] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2925b69964ad99ac5b3800905c319, State: Initialized, Role: FOLLOWER
I20260929 22:55:12.783654 8002 consensus_queue.cc:260] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.783780 8002 ts_tablet_manager.cc:1428] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:12.783950 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.783548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:36081)
0929 22:55:12.783743 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.783783 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
I20260929 22:55:12.784118 8003 tablet_bootstrap.cc:654] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:12.784183 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.783983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:55321)
0929 22:55:12.784102 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.784139 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":78,"threads_started":1}
I20260929 22:55:12.784431 7777 heartbeater.cc:503] Master 127.0.124.188:46219 was elected leader, sending a full tablet report...
I20260929 22:55:12.784567 7640 heartbeater.cc:503] Master 127.0.124.188:46219 was elected leader, sending a full tablet report...
I20260929 22:55:12.784797 8003 tablet_bootstrap.cc:492] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: No bootstrap required, opened a new log
I20260929 22:55:12.784839 8003 ts_tablet_manager.cc:1397] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:12.784960 8003 raft_consensus.cc:348] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.785036 8003 raft_consensus.cc:374] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:12.785055 8003 raft_consensus.cc:729] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46005e38018f486c84c8b2722d083cd6, State: Initialized, Role: FOLLOWER
I20260929 22:55:12.785123 8003 consensus_queue.cc:260] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.785254 8003 ts_tablet_manager.cc:1428] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:12.785390 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.785304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:39789)
0929 22:55:12.785340 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.785362 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260929 22:55:12.785609 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.785427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:56149)
0929 22:55:12.785544 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.785577 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":80,"threads_started":1}
I20260929 22:55:12.880517 8011 raft_consensus.cc:482] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:12.880613 8011 raft_consensus.cc:504] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.880769 8011 leader_election.cc:288] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841), 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:12.881024 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4a781151394a16bdc8bfb5d7e12979" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2925b69964ad99ac5b3800905c319" is_pre_election: true
I20260929 22:55:12.881110 7594 raft_consensus.cc:2454] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 0.
I20260929 22:55:12.881033 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4a781151394a16bdc8bfb5d7e12979" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2728acb7242c78a7f27de2788575a" is_pre_election: true
I20260929 22:55:12.881147 7731 raft_consensus.cc:2454] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 0.
I20260929 22:55:12.881316 7801 leader_election.cc:302] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2728acb7242c78a7f27de2788575a, 46005e38018f486c84c8b2722d083cd6; no voters:
I20260929 22:55:12.881443 8011 raft_consensus.cc:2781] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:12.881496 8011 raft_consensus.cc:482] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:12.881518 8011 raft_consensus.cc:3037] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:12.882218 8011 raft_consensus.cc:504] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.882344 8011 leader_election.cc:288] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 election: Requested vote from peers 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841), 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595)
I20260929 22:55:12.882510 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4a781151394a16bdc8bfb5d7e12979" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2925b69964ad99ac5b3800905c319"
I20260929 22:55:12.882534 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4a781151394a16bdc8bfb5d7e12979" candidate_uuid: "46005e38018f486c84c8b2722d083cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2728acb7242c78a7f27de2788575a"
I20260929 22:55:12.882587 7594 raft_consensus.cc:3037] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:12.882592 7731 raft_consensus.cc:3037] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:12.883307 7731 raft_consensus.cc:2454] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 1.
I20260929 22:55:12.883307 7594 raft_consensus.cc:2454] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46005e38018f486c84c8b2722d083cd6 in term 1.
I20260929 22:55:12.883522 7803 leader_election.cc:302] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e2925b69964ad99ac5b3800905c319, 46005e38018f486c84c8b2722d083cd6; no voters:
I20260929 22:55:12.883615 8011 raft_consensus.cc:2781] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:12.883760 8011 raft_consensus.cc:686] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 1 LEADER]: Becoming Leader. State: Replica: 46005e38018f486c84c8b2722d083cd6, State: Running, Role: LEADER
I20260929 22:55:12.883880 7913 heartbeater.cc:503] Master 127.0.124.188:46219 was elected leader, sending a full tablet report...
I20260929 22:55:12.883802 8011 consensus_queue.cc:237] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } }
I20260929 22:55:12.884224 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.884063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:53827)
0929 22:55:12.884125 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.884166 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 22:55:12.884622 7459 catalog_manager.cc:5495] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46005e38018f486c84c8b2722d083cd6 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "46005e38018f486c84c8b2722d083cd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46005e38018f486c84c8b2722d083cd6" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:12.895897 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.893694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.0.124.131:39553)
0929 22:55:12.893732 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:12.893734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:12.893741 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:55:12.893798 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:12.893799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:12.893807 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:12.893850 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:12.894097 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.894552 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.895331 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:12.895506 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:12.895554 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:12.895685 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:12.895709 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:12.895746 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:12.895807 (+ 61us) server_negotiation.cc:299] Negotiation successful
0929 22:55:12.895822 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:12.896746 7731 raft_consensus.cc:1261] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Refusing update from remote peer 46005e38018f486c84c8b2722d083cd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:12.896786 7594 raft_consensus.cc:1261] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Refusing update from remote peer 46005e38018f486c84c8b2722d083cd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:12.896973 8013 consensus_queue.cc:1035] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2728acb7242c78a7f27de2788575a" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:12.897084 8011 consensus_queue.cc:1035] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2925b69964ad99ac5b3800905c319" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 36595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:12.897876 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.897727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:52041)
0929 22:55:12.897803 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.897849 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260929 22:55:12.898301 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.898187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:39133)
0929 22:55:12.898238 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.898267 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:55:12.899161 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.899060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:48127)
0929 22:55:12.899098 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.899129 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 22:55:12.899264 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.899180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.129:40673)
0929 22:55:12.899216 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.899238 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 22:55:12.899657 8016 mvcc.cc:205] Tried to move back new op lower bound from 7334799412823273472 to 7334799412772794368. Current Snapshot: MvccSnapshot[applied={T|T < 7334799412823273472 or (T in {7334799412823273472})}]
I20260929 22:55:12.900300 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.900090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.131:35921)
0929 22:55:12.900241 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.900269 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260929 22:55:12.900337 7459 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:12.900410 7459 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:12.900825 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.900733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40095 (local address 127.0.124.130:35447)
0929 22:55:12.900766 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.900796 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:40095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260929 22:55:12.900837 8018 mvcc.cc:205] Tried to move back new op lower bound from 7334799412823273472 to 7334799412772794368. Current Snapshot: MvccSnapshot[applied={T|T < 7334799412823273472}]
I20260929 22:55:12.901859 7459 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 072ebd1186bc446ba3f04198e84e6e73: Sending DeleteTablet for 3 replicas of tablet ed4a781151394a16bdc8bfb5d7e12979
I20260929 22:55:12.902097 7711 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:12 UTC) from {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:45502
I20260929 22:55:12.902098 7847 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:12 UTC) from {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:48040
I20260929 22:55:12.902171 7574 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:12 UTC) from {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:52358
I20260929 22:55:12.902271 7710 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4a781151394a16bdc8bfb5d7e12979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:12 UTC) from {username='oryx', principal='oryx/127.0.124.188@KRBTEST.COM'} at 127.0.0.1:45502
I20260929 22:55:12.902349 8027 tablet_replica.cc:330] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: stopping tablet replica
I20260929 22:55:12.902403 8027 raft_consensus.cc:2229] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:12.902419 8025 tablet_replica.cc:330] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: stopping tablet replica
I20260929 22:55:12.902455 8027 raft_consensus.cc:2258] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:12.902470 8025 raft_consensus.cc:2229] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:12.902518 8025 raft_consensus.cc:2258] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:12.902784 8027 ts_tablet_manager.cc:1905] T ed4a781151394a16bdc8bfb5d7e12979 P 27e2925b69964ad99ac5b3800905c319: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:12.902789 8025 ts_tablet_manager.cc:1905] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:12.902794 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7424
I20260929 22:55:12.904619 8025 ts_tablet_manager.cc:1918] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:12.904682 8025 log.cc:1196] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/ed4a781151394a16bdc8bfb5d7e12979
I20260929 22:55:12.904915 8025 ts_tablet_manager.cc:1939] T ed4a781151394a16bdc8bfb5d7e12979 P 33c2728acb7242c78a7f27de2788575a: Deleting consensus metadata
I20260929 22:55:12.905102 8026 tablet_replica.cc:330] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: stopping tablet replica
I20260929 22:55:12.905160 8026 raft_consensus.cc:2229] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:12.905231 8026 raft_consensus.cc:2258] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:12.905364 7445 catalog_manager.cc:4841] TS 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841): tablet ed4a781151394a16bdc8bfb5d7e12979 (table test-table [id=b327c7300af74894bf0b08c453609a65]) successfully deleted
I20260929 22:55:12.905521 8026 ts_tablet_manager.cc:1905] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:55:12.905575 7445 catalog_manager.cc:4808] TS 33c2728acb7242c78a7f27de2788575a (127.0.124.130:46841): delete failed for tablet ed4a781151394a16bdc8bfb5d7e12979 because the tablet was not found. No further retry: Not found: Tablet not found: ed4a781151394a16bdc8bfb5d7e12979
I20260929 22:55:12.907342 8026 ts_tablet_manager.cc:1918] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:12.907403 8026 log.cc:1196] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/ed4a781151394a16bdc8bfb5d7e12979
I20260929 22:55:12.907629 8026 ts_tablet_manager.cc:1939] T ed4a781151394a16bdc8bfb5d7e12979 P 46005e38018f486c84c8b2722d083cd6: Deleting consensus metadata
I20260929 22:55:12.907936 7445 catalog_manager.cc:4841] TS 46005e38018f486c84c8b2722d083cd6 (127.0.124.131:39553): tablet ed4a781151394a16bdc8bfb5d7e12979 (table test-table [id=b327c7300af74894bf0b08c453609a65]) successfully deleted
I20260929 22:55:12.909739 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:12.909634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:36595 (local address 127.0.0.1:52364)
0929 22:55:12.909685 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:12.909717 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:36595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:55:12.909838 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7648
W20260929 22:55:12.909890 7447 catalog_manager.cc:4584] TS 27e2925b69964ad99ac5b3800905c319 (127.0.124.129:36595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed4a781151394a16bdc8bfb5d7e12979: Network error: Client connection negotiation failed: client connection to 127.0.124.129:36595: connect: Connection refused (error 111)
I20260929 22:55:12.915282 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7784
I20260929 22:55:12.920744 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7140
I20260929 22:55:12.925426 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 7328
2026-09-29T22:55:12Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4818 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:12 dist-test-slave-512q krb5kdc[8030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:12 dist-test-slave-512q krb5kdc[8030](info): set up 2 sockets
Sep 29 22:55:12 dist-test-slave-512q krb5kdc[8030](info): commencing operation
krb5kdc: starting...
W20260929 22:55:13.971094 498 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:14Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab.
Entry for principal oryx/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab.
I20260929 22:55:14.083374 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33353
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab
--principal=oryx/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:14.161556 8043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:14.161774 8043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:14.161808 8043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:14.162916 8043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:14.162979 8043 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:55:14.163008 8043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:14.163036 8043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:14.163064 8043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:14.163086 8043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:14.164538 8043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33353
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.190.keytab
--principal=oryx/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:14.164808 8043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:14.165040 8043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:14.169749 8051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:14.169781 8049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.169838 8043 server_base.cc:1034] running on GCE node
W20260929 22:55:14.169797 8048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.170253 8043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:14.170477 8043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:14.171612 8043 hybrid_clock.cc:648] HybridClock initialized: now 1790722514171594 us; error 36 us; skew 500 ppm
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:14.174006 8043 init.cc:377] Logged in from keytab as oryx/127.0.124.190@KRBTEST.COM (short username oryx)
I20260929 22:55:14.174429 8043 webserver.cc:460] Webserver started at http://127.0.124.190:36149/ using document root <none> and password file <none>
I20260929 22:55:14.174618 8043 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:14.174657 8043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:14.174743 8043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:14.175694 8043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "2ddc728152384fff9abc758ce3b257f5"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "5ac41db531cc5f6d94bbfff353b2ca9a"
server_key_iv: "87004f035670713b585651c3ead80bf7"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.175976 8043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "2ddc728152384fff9abc758ce3b257f5"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "5ac41db531cc5f6d94bbfff353b2ca9a"
server_key_iv: "87004f035670713b585651c3ead80bf7"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.177343 8043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:14.177999 8058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.178153 8043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:14.178249 8043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "2ddc728152384fff9abc758ce3b257f5"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "5ac41db531cc5f6d94bbfff353b2ca9a"
server_key_iv: "87004f035670713b585651c3ead80bf7"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.178319 8043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:14.190099 8043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:14.191825 8043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:14.191972 8043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:14.196427 8043 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:33353
I20260929 22:55:14.196471 8120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:33353 every 8 connection(s)
I20260929 22:55:14.196764 8043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:14.197345 8121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.197561 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8043
I20260929 22:55:14.197642 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:14.197849 498 external_mini_cluster.cc:1428] Setting key 70ee379f1be67547be91d5d97998e0b0
I20260929 22:55:14.199760 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Bootstrap starting.
I20260929 22:55:14.200354 8121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.200631 8121 log.cc:824] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:14.201238 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: No bootstrap required, opened a new log
I20260929 22:55:14.203122 8121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } }
I20260929 22:55:14.203287 8121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.203349 8121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ddc728152384fff9abc758ce3b257f5, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.203488 8121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } }
I20260929 22:55:14.203567 8121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:14.203604 8121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:14.203651 8121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 0 FOLLOWER]: Advancing to term 1
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:14.204181 8121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } }
I20260929 22:55:14.204329 8121 leader_election.cc:302] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ddc728152384fff9abc758ce3b257f5; no voters:
I20260929 22:55:14.204486 8121 leader_election.cc:288] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:14.204550 8126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:14.204697 8126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [term 1 LEADER]: Becoming Leader. State: Replica: 2ddc728152384fff9abc758ce3b257f5, State: Running, Role: LEADER
I20260929 22:55:14.204787 8121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:14.204823 8126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } }
I20260929 22:55:14.205142 8126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ddc728152384fff9abc758ce3b257f5. Latest consensus state: current_term: 1 leader_uuid: "2ddc728152384fff9abc758ce3b257f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } } }
I20260929 22:55:14.205149 8127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ddc728152384fff9abc758ce3b257f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc728152384fff9abc758ce3b257f5" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33353 } } }
I20260929 22:55:14.205222 8126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:14.205364 8127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:14.205411 8132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:14.205904 8132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:14.207826 8132 catalog_manager.cc:1347] Generated new cluster ID: f217557abf0a4f969778371c2483862f
I20260929 22:55:14.207875 8132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:14.208563 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.198332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41586 (local address 127.0.124.190:33353)
0929 22:55:14.198530 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.198539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.198569 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:55:14.198958 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.198964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.199015 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.199160 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.199757 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.200790 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.201604 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.202028 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.202141 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.204424 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.204429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.204429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.204440 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.206775 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.207158 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.207160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.207161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.207260 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.207664 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.207665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.207665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.207957 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.208103 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.208232 (+ 129us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.208367 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260929 22:55:14.224323 8132 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:14.224825 8132 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:14.227928 8132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Generated new TSK 0
I20260929 22:55:14.228122 8132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
I20260929 22:55:14.261458 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33353
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:14.342746 8147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:14.342983 8147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:14.343019 8147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:14.344159 8147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:14.344288 8147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:14.344354 8147 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:55:14.344419 8147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:14.345870 8147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:33353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:14.346118 8147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:14.346374 8147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:14.351397 8155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.351540 8147 server_base.cc:1034] running on GCE node
W20260929 22:55:14.351403 8152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:14.351642 8153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.351842 8147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:14.352087 8147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:14.353223 8147 hybrid_clock.cc:648] HybridClock initialized: now 1790722514353208 us; error 34 us; skew 500 ppm
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:14.355587 8147 init.cc:377] Logged in from keytab as oryx/127.0.124.129@KRBTEST.COM (short username oryx)
I20260929 22:55:14.356017 8147 webserver.cc:460] Webserver started at http://127.0.124.129:38603/ using document root <none> and password file <none>
I20260929 22:55:14.356292 8147 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:14.356356 8147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:14.356513 8147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:14.357476 8147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "93279594ca664e948fea145eb3b9e962"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "7de84083d34dbe5db6a1cd5a684f79c7"
server_key_iv: "2c2fb1647e9d11cbc90500b00d668046"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.357841 8147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "93279594ca664e948fea145eb3b9e962"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "7de84083d34dbe5db6a1cd5a684f79c7"
server_key_iv: "2c2fb1647e9d11cbc90500b00d668046"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.359120 8147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:14.359851 8162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.360049 8147 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:14.360132 8147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "93279594ca664e948fea145eb3b9e962"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "7de84083d34dbe5db6a1cd5a684f79c7"
server_key_iv: "2c2fb1647e9d11cbc90500b00d668046"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.360206 8147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:14.375298 8147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:14.377352 8147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:14.377506 8147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:14.378024 8147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:14.378085 8147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.378130 8147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:14.378156 8147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:14.385269 8147 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:38319
I20260929 22:55:14.385450 8280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:38319 every 8 connection(s)
I20260929 22:55:14.385707 8147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:14.386629 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8147
I20260929 22:55:14.386750 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:14.387009 498 external_mini_cluster.cc:1428] Setting key 57c26aa9f96794779c8be770426553ed
I20260929 22:55:14.387802 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.378521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:40551 (local address 127.0.124.190:33353)
0929 22:55:14.378590 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.378593 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.378739 (+ 146us) server_negotiation.cc:407] Connection header received
0929 22:55:14.379218 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.379219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.379234 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.379318 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.379968 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.380856 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.382032 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.382262 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.382332 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.384884 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.384886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.384886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.384894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.386440 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.386824 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.386825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.386826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.386891 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.387154 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.387155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.387155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.387279 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.387357 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.387615 (+ 258us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.387702 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:55:14.387907 8171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.378449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.129:40551)
0929 22:55:14.378613 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.378651 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.379123 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.379407 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.379409 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.379680 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.379893 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.379898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.380952 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.380953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.381949 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.381952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.382349 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.382350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.382485 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.382952 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.382962 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.384791 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.386513 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.386517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.386518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.386724 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.386961 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.386962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.386962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.387071 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.387349 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.387354 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.387472 (+ 118us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.387587 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.387731 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260929 22:55:14.389355 8281 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33353
I20260929 22:55:14.389457 8281 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:14.389629 8281 heartbeater.cc:511] Master 127.0.124.190:33353 requested a full tablet report, sending...
I20260929 22:55:14.390175 8074 ts_manager.cc:194] Registered new tserver with Master: 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319)
I20260929 22:55:14.391057 8074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:40551
I20260929 22:55:14.394826 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.389318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:43159 (local address 127.0.124.190:33353)
0929 22:55:14.389353 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.389354 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.389363 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:14.389430 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.389431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.389440 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.389511 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.389844 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.390420 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.391127 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.391403 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.391469 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.392399 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.392400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.392401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.392407 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.393739 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.394090 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.394091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.394092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.394143 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.394334 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.394335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.394335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.394437 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.394521 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.394665 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.394731 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:55:14.394841 8288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.389196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.129:43159)
0929 22:55:14.389310 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.389323 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.389377 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.389519 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.389519 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.389700 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.389766 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.389768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.390509 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.390510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.391038 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.391039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.391469 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.391470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.391534 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.391976 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.391987 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.392306 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.393837 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.393838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.393839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.394009 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.394211 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.394212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.394212 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.394269 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.394514 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.394515 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.394555 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.394639 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.394732 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
I20260929 22:55:14.412883 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33353
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:14.493531 8290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:14.493727 8290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:14.493750 8290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:14.494848 8290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:14.494881 8290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:14.494901 8290 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:55:14.494918 8290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:14.496316 8290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:33353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:14.496549 8290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:14.496732 8290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:14.501513 8296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:14.501477 8298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:14.501485 8295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.501756 8290 server_base.cc:1034] running on GCE node
I20260929 22:55:14.501945 8290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:14.502164 8290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:14.503296 8290 hybrid_clock.cc:648] HybridClock initialized: now 1790722514503282 us; error 32 us; skew 500 ppm
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:14.505939 8290 init.cc:377] Logged in from keytab as oryx/127.0.124.130@KRBTEST.COM (short username oryx)
I20260929 22:55:14.506390 8290 webserver.cc:460] Webserver started at http://127.0.124.130:43425/ using document root <none> and password file <none>
I20260929 22:55:14.506654 8290 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:14.506699 8290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:14.506835 8290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:14.507855 8290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "e50937c37c764f0cbc7a30835e8860bd"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "d9a36efdeaa02e4d00f5839b0453f599"
server_key_iv: "6da1d431bab910d6ce1d84cb2f09009c"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.508194 8290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "e50937c37c764f0cbc7a30835e8860bd"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "d9a36efdeaa02e4d00f5839b0453f599"
server_key_iv: "6da1d431bab910d6ce1d84cb2f09009c"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.509563 8290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:14.510242 8305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.510496 8290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:14.510596 8290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "e50937c37c764f0cbc7a30835e8860bd"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "d9a36efdeaa02e4d00f5839b0453f599"
server_key_iv: "6da1d431bab910d6ce1d84cb2f09009c"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.510664 8290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:14.524595 8290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:14.526476 8290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:14.526645 8290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:14.527125 8290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:14.527196 8290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.527231 8290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:14.527271 8290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.533787 8290 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:35145
I20260929 22:55:14.533871 8423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:35145 every 8 connection(s)
I20260929 22:55:14.534143 8290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:14.537132 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8290
I20260929 22:55:14.537261 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:14.537472 498 external_mini_cluster.cc:1428] Setting key f38944d7c08a04672adfa9b12e79dfb3
I20260929 22:55:14.537910 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.527804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:46933 (local address 127.0.124.190:33353)
0929 22:55:14.527874 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.527877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.528132 (+ 255us) server_negotiation.cc:407] Connection header received
0929 22:55:14.528792 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.528793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.528805 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.528846 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.529673 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.530576 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.532115 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.532502 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.532591 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.535078 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.535079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.535080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.535086 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.536504 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.536838 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.536838 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.536839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.536886 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.537169 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.537169 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.537170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.537316 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.537379 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.537735 (+ 356us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.537827 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:55:14.538107 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.527779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.130:46933)
0929 22:55:14.528030 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.528058 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.528690 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.528937 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.528942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.529303 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.529564 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.529572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.530686 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.530687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.532030 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.532033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.532592 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.532593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.532756 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.533362 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.533369 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.534996 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.536564 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.536569 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.536570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.536780 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.536942 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.536942 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.536942 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.537100 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.537379 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.537385 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.537593 (+ 208us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.537706 (+ 113us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.537880 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":99,"threads_started":1}
I20260929 22:55:14.538509 8424 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33353
I20260929 22:55:14.538586 8424 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:14.538719 8424 heartbeater.cc:511] Master 127.0.124.190:33353 requested a full tablet report, sending...
I20260929 22:55:14.539031 8074 ts_manager.cc:194] Registered new tserver with Master: e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145)
I20260929 22:55:14.539351 8074 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:46933
WARNING: no policy specified for oryx/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:55:14.545462 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.540135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:54237 (local address 127.0.124.190:33353)
0929 22:55:14.540171 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.540173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.540290 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:55:14.540359 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.540360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.540369 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.540426 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.540729 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.541200 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.541877 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.542071 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.542145 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.543002 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.543004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.543004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.543010 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.544347 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.544708 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.544709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.544709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.544773 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.544966 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.544966 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.544967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.545101 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.545168 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.545311 (+ 143us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.545381 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:55:14.545485 8431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.540091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.130:54237)
0929 22:55:14.540243 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.540252 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.540305 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.540437 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.540438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.540599 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.540648 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.540649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.541284 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.541285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.541816 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.541817 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.542147 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.542148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.542208 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.542653 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.542657 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.542922 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.544468 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.544469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.544469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.544637 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.544848 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.544849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.544849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.544905 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.545170 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.545171 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.545212 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.545287 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.545379 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
I20260929 22:55:14.562422 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33353
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:14.640868 8433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:14.641085 8433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:14.641122 8433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:14.642248 8433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:14.642307 8433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:14.642339 8433 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:55:14.642374 8433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:14.643750 8433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.124.190:33353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:14.643997 8433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:14.644222 8433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:14.649117 8438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.649158 8433 server_base.cc:1034] running on GCE node
W20260929 22:55:14.649156 8439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:14.649132 8441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:14.649499 8433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:14.649729 8433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:14.650913 8433 hybrid_clock.cc:648] HybridClock initialized: now 1790722514650893 us; error 34 us; skew 500 ppm
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:14.653339 8433 init.cc:377] Logged in from keytab as oryx/127.0.124.131@KRBTEST.COM (short username oryx)
I20260929 22:55:14.653754 8433 webserver.cc:460] Webserver started at http://127.0.124.131:33659/ using document root <none> and password file <none>
I20260929 22:55:14.653939 8433 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:14.653977 8433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:14.654062 8433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:14.654968 8433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "f50c41fe96f44907be9a851b05e4ae90"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "f18280f33e3ea984df8ea2f19986e083"
server_key_iv: "381f4784ff5da141bdbd609f2dff91da"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.655246 8433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "f50c41fe96f44907be9a851b05e4ae90"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "f18280f33e3ea984df8ea2f19986e083"
server_key_iv: "381f4784ff5da141bdbd609f2dff91da"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.656477 8433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:14.657148 8448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.657302 8433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:14.657375 8433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "f50c41fe96f44907be9a851b05e4ae90"
format_stamp: "Formatted at 2026-09-29 22:55:14 on dist-test-slave-512q"
server_key: "f18280f33e3ea984df8ea2f19986e083"
server_key_iv: "381f4784ff5da141bdbd609f2dff91da"
server_key_version: "encryptionkey@0"
I20260929 22:55:14.657423 8433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:14.677898 8433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:14.680154 8433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:14.680351 8433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:14.680896 8433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:14.680948 8433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.680994 8433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:14.681018 8433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:14.687691 8433 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:45361
I20260929 22:55:14.688035 8564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:45361 every 8 connection(s)
I20260929 22:55:14.688086 8433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:14.690402 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.681292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44581 (local address 127.0.124.190:33353)
0929 22:55:14.681359 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.681361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.681596 (+ 235us) server_negotiation.cc:407] Connection header received
0929 22:55:14.682095 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.682096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.682109 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.682149 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.682991 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.683837 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.684966 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.685167 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.685245 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.687511 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.687512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.687513 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.687521 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.689032 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.689452 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.689453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.689453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.689509 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.689770 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.689771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.689772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.689879 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.689954 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.690235 (+ 281us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.690311 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:55:14.690594 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.681307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.131:44581)
0929 22:55:14.681473 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.681505 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.681986 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.682230 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.682234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.682578 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.682876 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.682884 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.683944 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.683945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.684854 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.684857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.685270 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.685271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.685384 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.685829 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.685836 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.687414 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.689124 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.689130 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.689132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.689346 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.689585 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.689598 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.689598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.689702 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.689946 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.689951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.690095 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.690201 (+ 106us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.690364 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":80,"threads_started":1}
I20260929 22:55:14.691047 8565 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33353
I20260929 22:55:14.691126 8565 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:14.691305 8565 heartbeater.cc:511] Master 127.0.124.190:33353 requested a full tablet report, sending...
I20260929 22:55:14.691707 8075 ts_manager.cc:194] Registered new tserver with Master: f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:14.692160 8075 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:44581
I20260929 22:55:14.696684 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.692002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:33433 (local address 127.0.124.190:33353)
0929 22:55:14.692040 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.692042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.692159 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:55:14.692244 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.692245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.692254 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.692308 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.692659 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.693104 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.693731 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.693898 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.693947 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.694723 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.694723 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.694724 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.694728 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.695790 (+ 1062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.696080 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.696080 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.696080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.696125 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.696344 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.696345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.696345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.696430 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.696477 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.696580 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.696632 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:14.696694 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.691949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.124.131:33433)
0929 22:55:14.692090 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.692100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.692170 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.692312 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.692313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.692495 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:14.692584 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.692585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.693191 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.693192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.693667 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.693668 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.693965 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.693965 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.694008 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.694393 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:14.694398 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:14.694658 (+ 260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:14.695852 (+ 1194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.695853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.695853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.696021 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.696176 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:14.696176 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:14.696177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:14.696278 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:14.696482 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:14.696483 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:14.696514 (+ 31us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.696565 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.696632 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260929 22:55:14.697189 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8433
I20260929 22:55:14.697309 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:14.697547 498 external_mini_cluster.cc:1428] Setting key dba8aad9141483aef5a488dbb3accaa9
I20260929 22:55:14.698407 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:55:14.719662 8124 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:14.714304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.0.124.190:33353)
0929 22:55:14.714342 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.714344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.714353 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:14.714393 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.714394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.714404 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.714470 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.715212 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.715756 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.716555 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.716735 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.716812 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.719584 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41600: BlockingRecv error: recv got EOF from 127.0.0.1:41600 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Sep 29 22:55:14 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:14.726218 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.720301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.0.124.190:33353)
0929 22:55:14.720349 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.720351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.720499 (+ 148us) server_negotiation.cc:407] Connection header received
0929 22:55:14.720525 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.720525 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.720533 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.720580 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:14.720998 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.721442 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.722044 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.722203 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.722248 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.724148 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:14.724149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:14.724149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:14.724155 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:14.725298 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.725605 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.725605 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.725606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.725651 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:14.725823 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:14.725824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:14.725824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:14.725944 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:14.726030 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.726106 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.726160 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:55:14.727638 8075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:14.729549 8075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:14.735684 8588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45361 (local address 127.0.0.1:34668)
0929 22:55:14.731926 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.731976 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.732058 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.732389 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.732392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.732394 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:14.732457 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.732459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733336 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.733338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.734502 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.734505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735389 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.735465 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735476 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.735550 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.735597 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":61,"threads_started":1}
I20260929 22:55:14.735718 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.0.124.131:45361)
0929 22:55:14.731826 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.731831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.732044 (+ 213us) server_negotiation.cc:407] Connection header received
0929 22:55:14.732147 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.732150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.732167 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.732320 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:14.732541 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733232 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.734581 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735305 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735378 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735449 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.735574 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.735623 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260929 22:55:14.735885 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42576 (local address 127.0.124.130:35145)
0929 22:55:14.731980 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.731985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.732142 (+ 157us) server_negotiation.cc:407] Connection header received
0929 22:55:14.732181 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.732183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.732199 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.732288 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:14.732590 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733689 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.734871 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735377 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735443 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735516 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.735725 (+ 209us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.735778 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260929 22:55:14.736029 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60408 (local address 127.0.124.129:38319)
0929 22:55:14.732080 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.732083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.732200 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:55:14.732313 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.732315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.732330 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.732392 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:14.732553 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733667 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.734897 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735588 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735647 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735715 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.735888 (+ 173us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.735923 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":86,"threads_started":1}
I20260929 22:55:14.736073 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35145 (local address 127.0.0.1:42576)
0929 22:55:14.731985 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.731997 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.732058 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.732461 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.732461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.732463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:14.732511 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.732513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733776 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.733777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.734785 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.734787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735548 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.735609 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735612 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.735657 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.735686 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":27,"thread_start_us":66,"threads_started":1}
I20260929 22:55:14.735978 8590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.731799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.0.1:60408)
0929 22:55:14.732128 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.732139 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.732234 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.732404 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.732405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.732407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:14.732471 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.732473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.733766 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.733767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.734809 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.734812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.735749 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.735751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.735816 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.735820 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.735874 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.735907 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":45,"thread_start_us":65,"threads_started":1}
I20260929 22:55:14.736785 8343 tablet_service.cc:1467] Processing CreateTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (DEFAULT_TABLE table=test-table [id=9f4b5b921d034b178601bd01ed49d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.736783 8499 tablet_service.cc:1467] Processing CreateTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (DEFAULT_TABLE table=test-table [id=9f4b5b921d034b178601bd01ed49d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.737087 8499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.737131 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.740088 8593 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Bootstrap starting.
I20260929 22:55:14.740165 8594 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Bootstrap starting.
I20260929 22:55:14.740746 8593 tablet_bootstrap.cc:654] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.740789 8594 tablet_bootstrap.cc:654] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.740835 8213 tablet_service.cc:1467] Processing CreateTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (DEFAULT_TABLE table=test-table [id=9f4b5b921d034b178601bd01ed49d100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.741063 8593 log.cc:824] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:14.741114 8594 log.cc:824] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:14.741169 8213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.741711 8594 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: No bootstrap required, opened a new log
I20260929 22:55:14.741780 8593 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: No bootstrap required, opened a new log
I20260929 22:55:14.741784 8594 ts_tablet_manager.cc:1397] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:14.741846 8593 ts_tablet_manager.cc:1397] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:55:14.743275 8594 raft_consensus.cc:348] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.743418 8594 raft_consensus.cc:374] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.743453 8594 raft_consensus.cc:729] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.743584 8594 consensus_queue.cc:260] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.743829 8594 ts_tablet_manager.cc:1428] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:55:14.743956 8424 heartbeater.cc:503] Master 127.0.124.190:33353 was elected leader, sending a full tablet report...
I20260929 22:55:14.743856 8593 raft_consensus.cc:348] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.744022 8593 raft_consensus.cc:374] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.744067 8593 raft_consensus.cc:729] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50c41fe96f44907be9a851b05e4ae90, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.744171 8593 consensus_queue.cc:260] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.744446 8593 ts_tablet_manager.cc:1428] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:55:14.744558 8565 heartbeater.cc:503] Master 127.0.124.190:33353 was elected leader, sending a full tablet report...
I20260929 22:55:14.745277 8599 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Bootstrap starting.
I20260929 22:55:14.745872 8599 tablet_bootstrap.cc:654] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.746093 8599 log.cc:824] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:14.746670 8599 tablet_bootstrap.cc:492] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: No bootstrap required, opened a new log
I20260929 22:55:14.746721 8599 ts_tablet_manager.cc:1397] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:14.748057 8599 raft_consensus.cc:348] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.748168 8599 raft_consensus.cc:374] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.748188 8599 raft_consensus.cc:729] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.748334 8599 consensus_queue.cc:260] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.748517 8599 ts_tablet_manager.cc:1428] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:55:14.748580 8281 heartbeater.cc:503] Master 127.0.124.190:33353 was elected leader, sending a full tablet report...
W20260929 22:55:14.784694 8425 tablet.cc:2369] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:14.794811 8601 raft_consensus.cc:482] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:14.794936 8601 raft_consensus.cc:504] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.795218 8601 leader_election.cc:288] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361), e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145)
I20260929 22:55:14.799103 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.795550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:51337 (local address 127.0.124.131:45361)
0929 22:55:14.795591 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.795593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.795600 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:55:14.795624 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.795625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.795633 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.795689 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:14.795870 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.796694 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798212 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.798768 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798830 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.798838 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.799003 (+ 165us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.799035 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:55:14.799103 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.795485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:53197 (local address 127.0.124.130:35145)
0929 22:55:14.795531 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.795533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.795664 (+ 131us) server_negotiation.cc:407] Connection header received
0929 22:55:14.795732 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.795733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.795741 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.795785 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:14.795950 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.796699 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798211 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.798753 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798830 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.798838 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.799000 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.799036 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:55:14.799134 8171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.795413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45361 (local address 127.0.124.129:51337)
0929 22:55:14.795470 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.795496 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.795548 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.795710 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.795710 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.795712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:14.795796 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.795798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.796779 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.796780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.798127 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.798130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.798836 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.798922 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.798924 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.798982 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.799024 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":92}
I20260929 22:55:14.799124 8602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.795414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35145 (local address 127.0.124.129:53197)
0929 22:55:14.795593 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:14.795601 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:14.795658 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:14.795806 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:14.795806 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:14.795817 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:14.795883 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.795884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.796779 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.796780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.798127 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:14.798130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.798837 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.798837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:14.798921 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.798925 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:14.798983 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:55:14.799024 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":104,"thread_start_us":102,"threads_started":1}
I20260929 22:55:14.799472 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c26ffe2c93b4579be66cfc2b8b61b9d" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90" is_pre_election: true
I20260929 22:55:14.799630 8519 raft_consensus.cc:2454] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:14.799602 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c26ffe2c93b4579be66cfc2b8b61b9d" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd" is_pre_election: true
I20260929 22:55:14.799749 8377 raft_consensus.cc:2454] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:14.799846 8164 leader_election.cc:302] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:14.800035 8601 raft_consensus.cc:2781] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:14.800076 8601 raft_consensus.cc:482] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:14.800091 8601 raft_consensus.cc:3037] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:14.801023 8601 raft_consensus.cc:504] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.801162 8601 leader_election.cc:288] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Requested vote from peers f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361), e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145)
I20260929 22:55:14.801311 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c26ffe2c93b4579be66cfc2b8b61b9d" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90"
I20260929 22:55:14.801368 8519 raft_consensus.cc:3037] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:14.802028 8519 raft_consensus.cc:2454] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:14.802114 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c26ffe2c93b4579be66cfc2b8b61b9d" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd"
I20260929 22:55:14.802178 8164 leader_election.cc:302] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:14.802203 8377 raft_consensus.cc:3037] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:14.802259 8601 raft_consensus.cc:2781] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:14.802407 8601 raft_consensus.cc:686] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 1 LEADER]: Becoming Leader. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Running, Role: LEADER
I20260929 22:55:14.802496 8601 consensus_queue.cc:237] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } }
I20260929 22:55:14.803076 8377 raft_consensus.cc:2454] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:14.803247 8075 catalog_manager.cc:5495] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93279594ca664e948fea145eb3b9e962 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } health_report { overall_health: HEALTHY } } }
I20260929 22:55:14.808759 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:14.806724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60418 (local address 127.0.124.129:38319)
0929 22:55:14.806778 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:14.806780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:14.806787 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:55:14.806834 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:14.806835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:14.806848 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:14.806903 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:14.806990 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.807418 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.808091 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:14.808316 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:14.808367 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:14.808496 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:14.808576 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:14.808632 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:14.808646 (+ 14us) server_negotiation.cc:299] Negotiation successful
0929 22:55:14.808661 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:55:14.810278 8519 raft_consensus.cc:1261] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:14.810282 8377 raft_consensus.cc:1261] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:14.810602 8601 consensus_queue.cc:1035] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:14.810724 8603 consensus_queue.cc:1035] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:14.812680 8606 mvcc.cc:205] Tried to move back new op lower bound from 7334799420660768768 to 7334799420631552000. Current Snapshot: MvccSnapshot[applied={T|T < 7334799420660768768}]
I20260929 22:55:14.815003 8075 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:14.815096 8075 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:14.815802 8075 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Sending DeleteTablet for 3 replicas of tablet 5c26ffe2c93b4579be66cfc2b8b61b9d
I20260929 22:55:14.816118 8343 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:14 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:42576
I20260929 22:55:14.816151 8499 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:14 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:34668
I20260929 22:55:14.816154 8213 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c26ffe2c93b4579be66cfc2b8b61b9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:14 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60408
I20260929 22:55:14.816442 8616 tablet_replica.cc:330] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: stopping tablet replica
I20260929 22:55:14.816532 8616 raft_consensus.cc:2229] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:14.816524 8075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 22:55:14.816653 8616 raft_consensus.cc:2258] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 22:55:14.816699 8075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:14.817143 8615 tablet_replica.cc:330] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: stopping tablet replica
I20260929 22:55:14.817231 8615 raft_consensus.cc:2229] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:14.817487 8615 raft_consensus.cc:2258] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:14.817852 8343 tablet_service.cc:1467] Processing CreateTablet for tablet 648d67eaa61548a79e69e2c78bc602cd (DEFAULT_TABLE table=test-table [id=ae66e63e433440c8a84c4aff57b5902f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.817850 8213 tablet_service.cc:1467] Processing CreateTablet for tablet 648d67eaa61548a79e69e2c78bc602cd (DEFAULT_TABLE table=test-table [id=ae66e63e433440c8a84c4aff57b5902f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.817871 8499 tablet_service.cc:1467] Processing CreateTablet for tablet 648d67eaa61548a79e69e2c78bc602cd (DEFAULT_TABLE table=test-table [id=ae66e63e433440c8a84c4aff57b5902f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:14.817967 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648d67eaa61548a79e69e2c78bc602cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.817971 8213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648d67eaa61548a79e69e2c78bc602cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.817966 8499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648d67eaa61548a79e69e2c78bc602cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:14.819384 8594 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Bootstrap starting.
I20260929 22:55:14.819387 8593 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Bootstrap starting.
I20260929 22:55:14.819416 8599 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Bootstrap starting.
I20260929 22:55:14.819833 8599 tablet_bootstrap.cc:654] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.819849 8593 tablet_bootstrap.cc:654] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.819849 8594 tablet_bootstrap.cc:654] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:14.820338 8616 ts_tablet_manager.cc:1905] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:14.820602 8594 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: No bootstrap required, opened a new log
I20260929 22:55:14.820662 8594 ts_tablet_manager.cc:1397] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:14.820809 8594 raft_consensus.cc:348] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.820883 8594 raft_consensus.cc:374] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.820907 8594 raft_consensus.cc:729] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.820963 8594 consensus_queue.cc:260] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.821053 8594 ts_tablet_manager.cc:1428] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:14.821086 8615 ts_tablet_manager.cc:1905] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:14.822613 8615 ts_tablet_manager.cc:1918] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:14.822822 8615 log.cc:1196] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/5c26ffe2c93b4579be66cfc2b8b61b9d
I20260929 22:55:14.823086 8615 ts_tablet_manager.cc:1939] T 5c26ffe2c93b4579be66cfc2b8b61b9d P e50937c37c764f0cbc7a30835e8860bd: Deleting consensus metadata
I20260929 22:55:14.823462 8062 catalog_manager.cc:4841] TS e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145): tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (table test-table [id=9f4b5b921d034b178601bd01ed49d100]) successfully deleted
I20260929 22:55:14.823590 8616 ts_tablet_manager.cc:1918] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:14.823662 8616 log.cc:1196] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/5c26ffe2c93b4579be66cfc2b8b61b9d
I20260929 22:55:14.823902 8616 ts_tablet_manager.cc:1939] T 5c26ffe2c93b4579be66cfc2b8b61b9d P f50c41fe96f44907be9a851b05e4ae90: Deleting consensus metadata
I20260929 22:55:14.824386 8617 tablet_replica.cc:330] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: stopping tablet replica
I20260929 22:55:14.824333 8060 catalog_manager.cc:4841] TS f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361): tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (table test-table [id=9f4b5b921d034b178601bd01ed49d100]) successfully deleted
I20260929 22:55:14.824506 8617 raft_consensus.cc:2229] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:14.824561 8599 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: No bootstrap required, opened a new log
I20260929 22:55:14.824601 8617 raft_consensus.cc:2258] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:14.824615 8599 ts_tablet_manager.cc:1397] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260929 22:55:14.824743 8599 raft_consensus.cc:348] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.824805 8599 raft_consensus.cc:374] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.824832 8599 raft_consensus.cc:729] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.824873 8599 consensus_queue.cc:260] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.824963 8599 ts_tablet_manager.cc:1428] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:14.825161 8593 tablet_bootstrap.cc:492] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: No bootstrap required, opened a new log
I20260929 22:55:14.825203 8593 ts_tablet_manager.cc:1397] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260929 22:55:14.825328 8593 raft_consensus.cc:348] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.825384 8593 raft_consensus.cc:374] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:14.825404 8593 raft_consensus.cc:729] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50c41fe96f44907be9a851b05e4ae90, State: Initialized, Role: FOLLOWER
I20260929 22:55:14.825459 8593 consensus_queue.cc:260] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:14.825539 8593 ts_tablet_manager.cc:1428] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:14.825937 8617 ts_tablet_manager.cc:1905] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:14.827155 8617 ts_tablet_manager.cc:1918] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:14.827234 8617 log.cc:1196] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/5c26ffe2c93b4579be66cfc2b8b61b9d
I20260929 22:55:14.827463 8617 ts_tablet_manager.cc:1939] T 5c26ffe2c93b4579be66cfc2b8b61b9d P 93279594ca664e948fea145eb3b9e962: Deleting consensus metadata
I20260929 22:55:14.827790 8062 catalog_manager.cc:4841] TS 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319): tablet 5c26ffe2c93b4579be66cfc2b8b61b9d (table test-table [id=9f4b5b921d034b178601bd01ed49d100]) successfully deleted
W20260929 22:55:14.886507 8282 tablet.cc:2369] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:55:14.938824 8566 tablet.cc:2369] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:15.027818 8597 raft_consensus.cc:482] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:15.027926 8597 raft_consensus.cc:504] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.028311 8597 leader_election.cc:288] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.032052 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.028572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:45707 (local address 127.0.124.129:38319)
0929 22:55:15.028623 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.028625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.028670 (+ 45us) server_negotiation.cc:407] Connection header received
0929 22:55:15.028738 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.028739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.028749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.028792 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:15.028935 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.029677 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031168 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.031701 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031772 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.031780 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.031946 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.031986 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:55:15.032095 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.028570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:38909 (local address 127.0.124.131:45361)
0929 22:55:15.028616 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.028618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.028628 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:15.028659 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.028660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.028670 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.028745 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:15.028924 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.029662 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031168 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.031696 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031772 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.031780 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.031962 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.032029 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:15.032083 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.028483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:45361 (local address 127.0.124.130:38909)
0929 22:55:15.028541 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.028553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.028601 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.028757 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.028758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.028759 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:15.028838 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.028840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.029750 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.029751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.031077 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.031080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.031781 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.031870 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.031873 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.031952 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.031979 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":43}
I20260929 22:55:15.032096 8621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.028491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.124.130:45707)
0929 22:55:15.028619 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.028628 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.028677 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.028803 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.028804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.028806 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:15.028871 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.028872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.029750 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.029751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.031077 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.031080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.031781 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.031782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.031869 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.031873 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.031935 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.031978 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":94,"thread_start_us":56,"threads_started":1}
I20260929 22:55:15.032429 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648d67eaa61548a79e69e2c78bc602cd" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90" is_pre_election: true
I20260929 22:55:15.032536 8519 raft_consensus.cc:2454] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 0.
I20260929 22:55:15.032483 8234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648d67eaa61548a79e69e2c78bc602cd" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93279594ca664e948fea145eb3b9e962" is_pre_election: true
I20260929 22:55:15.032642 8234 raft_consensus.cc:2454] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 0.
I20260929 22:55:15.032711 8307 leader_election.cc:302] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e50937c37c764f0cbc7a30835e8860bd, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:15.032829 8597 raft_consensus.cc:2781] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:15.032864 8597 raft_consensus.cc:482] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:15.032888 8597 raft_consensus.cc:3037] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.033524 8597 raft_consensus.cc:504] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.033661 8597 leader_election.cc:288] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 election: Requested vote from peers 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.033789 8234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648d67eaa61548a79e69e2c78bc602cd" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93279594ca664e948fea145eb3b9e962"
I20260929 22:55:15.033795 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648d67eaa61548a79e69e2c78bc602cd" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90"
I20260929 22:55:15.033860 8519 raft_consensus.cc:3037] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.033854 8234 raft_consensus.cc:3037] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.034447 8234 raft_consensus.cc:2454] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 1.
I20260929 22:55:15.034467 8519 raft_consensus.cc:2454] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 1.
I20260929 22:55:15.034626 8307 leader_election.cc:302] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e50937c37c764f0cbc7a30835e8860bd, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:15.034729 8597 raft_consensus.cc:2781] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:15.034816 8597 raft_consensus.cc:686] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 1 LEADER]: Becoming Leader. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Running, Role: LEADER
I20260929 22:55:15.034888 8597 consensus_queue.cc:237] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.035528 8075 catalog_manager.cc:5495] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e50937c37c764f0cbc7a30835e8860bd (127.0.124.130). New cstate: current_term: 1 leader_uuid: "e50937c37c764f0cbc7a30835e8860bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722514, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.190@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:15.071331 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.064884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33353 (local address 127.0.0.1:41608)
0929 22:55:15.065053 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.065076 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.065158 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.065312 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.065313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.065629 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:15.065672 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.065674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.066316 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.066317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.066844 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.066845 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.067187 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.067187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.067237 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.067731 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:15.067735 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:15.069098 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:15.070455 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:15.070460 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:15.070463 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:15.070651 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:15.070812 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:15.070812 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:15.070813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:15.070865 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:15.071064 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:15.071069 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:15.071108 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.071160 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.071242 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260929 22:55:15.071391 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.064914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41608 (local address 127.0.124.190:33353)
0929 22:55:15.064980 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.065028 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.065141 (+ 113us) server_negotiation.cc:407] Connection header received
0929 22:55:15.065236 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.065237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.065245 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.065309 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:15.065752 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.066235 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.066922 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.067109 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.067188 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.069173 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:15.069175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:15.069175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:15.069181 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:15.070385 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:15.070712 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:15.070712 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:15.070713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:15.070759 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:15.070912 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:15.070912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:15.070913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:15.071016 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:15.071065 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.071186 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.071286 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":40}
I20260929 22:55:15.073359 8075 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:41608:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:55:15.073536 8075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:15.074937 8213 tablet_service.cc:1467] Processing CreateTablet for tablet e8177271f94149cfb8b8b97a62a4ef63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=85d0381b7494445bbd233014f2a89239]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:55:15.074988 8343 tablet_service.cc:1467] Processing CreateTablet for tablet e8177271f94149cfb8b8b97a62a4ef63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=85d0381b7494445bbd233014f2a89239]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:55:15.074988 8499 tablet_service.cc:1467] Processing CreateTablet for tablet e8177271f94149cfb8b8b97a62a4ef63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=85d0381b7494445bbd233014f2a89239]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:55:15.075096 8213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8177271f94149cfb8b8b97a62a4ef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.075136 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8177271f94149cfb8b8b97a62a4ef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.075136 8499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8177271f94149cfb8b8b97a62a4ef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.076164 8599 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: Bootstrap starting.
I20260929 22:55:15.076503 8599 tablet_bootstrap.cc:654] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.076607 8593 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: Bootstrap starting.
I20260929 22:55:15.076607 8594 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: Bootstrap starting.
I20260929 22:55:15.076996 8594 tablet_bootstrap.cc:654] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.077028 8593 tablet_bootstrap.cc:654] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.077695 8593 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: No bootstrap required, opened a new log
I20260929 22:55:15.077762 8593 ts_tablet_manager.cc:1397] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:15.077867 8594 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: No bootstrap required, opened a new log
I20260929 22:55:15.077867 8599 tablet_bootstrap.cc:492] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: No bootstrap required, opened a new log
I20260929 22:55:15.077919 8599 ts_tablet_manager.cc:1397] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:55:15.077919 8594 ts_tablet_manager.cc:1397] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:15.077900 8593 raft_consensus.cc:348] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078002 8593 raft_consensus.cc:374] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.078028 8593 raft_consensus.cc:729] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50c41fe96f44907be9a851b05e4ae90, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.078040 8599 raft_consensus.cc:348] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078054 8594 raft_consensus.cc:348] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078087 8593 consensus_queue.cc:260] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078115 8594 raft_consensus.cc:374] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.078115 8599 raft_consensus.cc:374] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.078141 8599 raft_consensus.cc:729] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.078141 8594 raft_consensus.cc:729] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.078183 8593 ts_tablet_manager.cc:1428] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.078182 8599 consensus_queue.cc:260] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078181 8594 consensus_queue.cc:260] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.078259 8594 ts_tablet_manager.cc:1428] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.078259 8599 ts_tablet_manager.cc:1428] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.078243 8598 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.078341 8598 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.078495 8601 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.078593 8601 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.078725 8597 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.078800 8597 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.405462 8601 raft_consensus.cc:482] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:15.405550 8601 raft_consensus.cc:504] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.405716 8601 leader_election.cc:288] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.405922 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8177271f94149cfb8b8b97a62a4ef63" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd" is_pre_election: true
I20260929 22:55:15.405942 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8177271f94149cfb8b8b97a62a4ef63" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90" is_pre_election: true
I20260929 22:55:15.406035 8519 raft_consensus.cc:2454] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:15.406039 8377 raft_consensus.cc:2454] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:15.406183 8166 leader_election.cc:302] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, e50937c37c764f0cbc7a30835e8860bd; no voters:
I20260929 22:55:15.406289 8601 raft_consensus.cc:2781] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:15.406342 8601 raft_consensus.cc:482] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:15.406356 8601 raft_consensus.cc:3037] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.407037 8601 raft_consensus.cc:504] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.407156 8601 leader_election.cc:288] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Requested vote from peers e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.407280 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8177271f94149cfb8b8b97a62a4ef63" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd"
I20260929 22:55:15.407300 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8177271f94149cfb8b8b97a62a4ef63" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90"
I20260929 22:55:15.407368 8377 raft_consensus.cc:3037] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.407366 8519 raft_consensus.cc:3037] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.407910 8519 raft_consensus.cc:2454] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:15.408071 8377 raft_consensus.cc:2454] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:15.408083 8164 leader_election.cc:302] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:15.408317 8601 raft_consensus.cc:2781] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:15.408453 8601 raft_consensus.cc:686] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [term 1 LEADER]: Becoming Leader. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Running, Role: LEADER
I20260929 22:55:15.408509 8601 consensus_queue.cc:237] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.408715 8633 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: TxnStatusTablet state changed. Reason: New leader 93279594ca664e948fea145eb3b9e962. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.408795 8633 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:55:15.408923 8635 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:55:15.409027 8635 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:55:15.409066 8073 catalog_manager.cc:5495] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93279594ca664e948fea145eb3b9e962 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:15.431362 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.428993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.0.1:60432)
0929 22:55:15.429061 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.429073 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.429126 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.429283 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.429284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.429285 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:55:15.429333 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.429339 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.429958 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.429959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.430552 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.430554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.430921 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.430922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.430990 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.431003 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.431190 (+ 187us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.431199 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.431251 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.431296 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 22:55:15.431352 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.429052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.0.124.129:38319)
0929 22:55:15.429098 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.429101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.429110 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:15.429209 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.429210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.429221 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.429276 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.429407 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.429875 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.430638 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.430840 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.430920 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.431093 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.431128 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.431189 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.431256 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.431277 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:55:15.432533 8519 raft_consensus.cc:1261] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.432541 8377 raft_consensus.cc:1261] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.432821 8633 consensus_queue.cc:1035] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.432940 8601 consensus_queue.cc:1035] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.433609 8598 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: TxnStatusTablet state changed. Reason: New leader 93279594ca664e948fea145eb3b9e962. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.433629 8597 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: TxnStatusTablet state changed. Reason: New leader 93279594ca664e948fea145eb3b9e962. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.433709 8597 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.433709 8598 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.434650 8601 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.434727 8601 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:55:15.435395 8598 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.435526 8598 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P f50c41fe96f44907be9a851b05e4ae90: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.435432 8642 mvcc.cc:205] Tried to move back new op lower bound from 7334799423209746432 to 7334799423113576448. Current Snapshot: MvccSnapshot[applied={T|T < 7334799423209746432}]
I20260929 22:55:15.435863 8633 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.435943 8633 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P 93279594ca664e948fea145eb3b9e962: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:55:15.436257 8597 tablet_replica.cc:439] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } } }
I20260929 22:55:15.436342 8597 tablet_replica.cc:442] T e8177271f94149cfb8b8b97a62a4ef63 P e50937c37c764f0cbc7a30835e8860bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:55:15.436578 8639 mvcc.cc:205] Tried to move back new op lower bound from 7334799423209746432 to 7334799423113576448. Current Snapshot: MvccSnapshot[applied={T|T < 7334799423209746432}]
I20260929 22:55:15.440073 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.436779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42582 (local address 127.0.124.130:35145)
0929 22:55:15.436899 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.436901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.437183 (+ 282us) server_negotiation.cc:407] Connection header received
0929 22:55:15.437273 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.437274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.437293 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.437375 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.437468 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.438250 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.439162 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.439471 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.439544 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.439713 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.439840 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.439923 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.439967 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.439987 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260929 22:55:15.445268 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.442696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55391 (local address 127.0.124.129:38319)
0929 22:55:15.442745 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.442747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.442848 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:55:15.442947 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.442948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.442960 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.443009 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.443136 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.443697 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.444547 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.444737 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.444820 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.444997 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.445034 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.445104 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.445173 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.445191 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:55:15.445318 8653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.442624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.124.130:55391)
0929 22:55:15.442773 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.442790 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.442865 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.443022 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.443023 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.443024 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:55:15.443071 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.443072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.443795 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.443796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.444447 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.444449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.444841 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.444842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.444891 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.444904 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.445108 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.445110 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.445168 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.445214 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260929 22:55:15.447474 8519 raft_consensus.cc:1261] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Refusing update from remote peer e50937c37c764f0cbc7a30835e8860bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.447621 8234 raft_consensus.cc:1261] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Refusing update from remote peer e50937c37c764f0cbc7a30835e8860bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.447687 8597 consensus_queue.cc:1035] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.447889 8597 consensus_queue.cc:1035] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.456408 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.453576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:59991 (local address 127.0.124.130:35145)
0929 22:55:15.453645 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.453646 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.453716 (+ 70us) server_negotiation.cc:407] Connection header received
0929 22:55:15.453787 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.453787 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.453797 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.453852 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.453955 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.454663 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.455631 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.455936 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.456001 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.456129 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.456160 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.456241 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.456321 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.456340 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:55:15.456413 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.453520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35145 (local address 127.0.124.129:59991)
0929 22:55:15.453656 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.453672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.453725 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.453855 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.453855 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.453861 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:55:15.453911 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.453912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.454761 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.454762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.455564 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.455567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.456014 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.456015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.456053 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.456064 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.456259 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.456261 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.456316 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.456360 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":72,"threads_started":1}
I20260929 22:55:15.465076 8075 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.465176 8075 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.465801 8075 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Sending DeleteTablet for 3 replicas of tablet 648d67eaa61548a79e69e2c78bc602cd
I20260929 22:55:15.466035 8213 tablet_service.cc:1514] Processing DeleteTablet for tablet 648d67eaa61548a79e69e2c78bc602cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60408
I20260929 22:55:15.466178 8499 tablet_service.cc:1514] Processing DeleteTablet for tablet 648d67eaa61548a79e69e2c78bc602cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:34668
I20260929 22:55:15.466388 8662 tablet_replica.cc:330] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: stopping tablet replica
I20260929 22:55:15.466449 8662 raft_consensus.cc:2229] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.466482 8662 raft_consensus.cc:2258] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.466733 8662 ts_tablet_manager.cc:1905] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.468535 8662 ts_tablet_manager.cc:1918] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:55:15.468585 8662 log.cc:1196] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/648d67eaa61548a79e69e2c78bc602cd
I20260929 22:55:15.468799 8662 ts_tablet_manager.cc:1939] T 648d67eaa61548a79e69e2c78bc602cd P f50c41fe96f44907be9a851b05e4ae90: Deleting consensus metadata
I20260929 22:55:15.469079 8060 catalog_manager.cc:4841] TS f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361): tablet 648d67eaa61548a79e69e2c78bc602cd (table test-table [id=ae66e63e433440c8a84c4aff57b5902f]) successfully deleted
I20260929 22:55:15.469879 8343 tablet_service.cc:1514] Processing DeleteTablet for tablet 648d67eaa61548a79e69e2c78bc602cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:42576
I20260929 22:55:15.472332 8664 tablet_replica.cc:330] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: stopping tablet replica
I20260929 22:55:15.472512 8664 raft_consensus.cc:2229] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:15.472592 8664 raft_consensus.cc:2258] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.472815 8664 ts_tablet_manager.cc:1905] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.474481 8664 ts_tablet_manager.cc:1918] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:55:15.474536 8664 log.cc:1196] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/648d67eaa61548a79e69e2c78bc602cd
I20260929 22:55:15.474752 8664 ts_tablet_manager.cc:1939] T 648d67eaa61548a79e69e2c78bc602cd P e50937c37c764f0cbc7a30835e8860bd: Deleting consensus metadata
I20260929 22:55:15.474957 8661 tablet_replica.cc:330] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: stopping tablet replica
I20260929 22:55:15.475028 8661 raft_consensus.cc:2229] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.475078 8661 raft_consensus.cc:2258] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.475339 8661 ts_tablet_manager.cc:1905] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.475553 8062 catalog_manager.cc:4841] TS e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145): tablet 648d67eaa61548a79e69e2c78bc602cd (table test-table [id=ae66e63e433440c8a84c4aff57b5902f]) successfully deleted
I20260929 22:55:15.477087 8661 ts_tablet_manager.cc:1918] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:55:15.477149 8661 log.cc:1196] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/648d67eaa61548a79e69e2c78bc602cd
I20260929 22:55:15.477358 8661 ts_tablet_manager.cc:1939] T 648d67eaa61548a79e69e2c78bc602cd P 93279594ca664e948fea145eb3b9e962: Deleting consensus metadata
I20260929 22:55:15.477917 8062 catalog_manager.cc:4841] TS 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319): tablet 648d67eaa61548a79e69e2c78bc602cd (table test-table [id=ae66e63e433440c8a84c4aff57b5902f]) successfully deleted
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:55:15.497747 8124 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:15.490616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41616 (local address 127.0.124.190:33353)
0929 22:55:15.490658 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.490660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.490823 (+ 163us) server_negotiation.cc:407] Connection header received
0929 22:55:15.490907 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.490908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.490918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.491000 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:15.491769 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.492705 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.493806 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.494109 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.494181 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.497683 (+ 3502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41616: BlockingRecv error: recv got EOF from 127.0.0.1:41616 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM
I20260929 22:55:15.507300 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.498869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.0.124.190:33353)
0929 22:55:15.498905 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.498906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.499049 (+ 143us) server_negotiation.cc:407] Connection header received
0929 22:55:15.499110 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.499110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.499120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.499178 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:15.499730 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.500469 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.501461 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.501746 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.501812 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.504416 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:15.504418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:15.504418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:15.504426 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:15.506105 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:15.506489 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:15.506490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:15.506490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:15.506552 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:15.506779 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:15.506780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:15.506780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:15.506926 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:15.507030 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.507138 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.507209 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:15.509094 8075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:15.509258 8075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:15.510561 8343 tablet_service.cc:1467] Processing CreateTablet for tablet 003bfc8fec0645aab27b14532c36ad49 (DEFAULT_TABLE table=test-table [id=f12747dc9fcc457580bb6949e2858ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.510692 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003bfc8fec0645aab27b14532c36ad49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.510679 8213 tablet_service.cc:1467] Processing CreateTablet for tablet 003bfc8fec0645aab27b14532c36ad49 (DEFAULT_TABLE table=test-table [id=f12747dc9fcc457580bb6949e2858ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.510800 8213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003bfc8fec0645aab27b14532c36ad49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.512028 8499 tablet_service.cc:1467] Processing CreateTablet for tablet 003bfc8fec0645aab27b14532c36ad49 (DEFAULT_TABLE table=test-table [id=f12747dc9fcc457580bb6949e2858ac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.512136 8499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003bfc8fec0645aab27b14532c36ad49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.512130 8599 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Bootstrap starting.
I20260929 22:55:15.512598 8599 tablet_bootstrap.cc:654] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.513384 8594 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Bootstrap starting.
I20260929 22:55:15.513396 8599 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: No bootstrap required, opened a new log
I20260929 22:55:15.513437 8599 ts_tablet_manager.cc:1397] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:15.513546 8599 raft_consensus.cc:348] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.513607 8599 raft_consensus.cc:374] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.513626 8599 raft_consensus.cc:729] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.513667 8599 consensus_queue.cc:260] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.513747 8599 ts_tablet_manager.cc:1428] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.513810 8594 tablet_bootstrap.cc:654] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.514128 8593 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Bootstrap starting.
I20260929 22:55:15.514494 8593 tablet_bootstrap.cc:654] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.515204 8593 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: No bootstrap required, opened a new log
I20260929 22:55:15.515249 8593 ts_tablet_manager.cc:1397] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:15.515389 8593 raft_consensus.cc:348] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.515468 8593 raft_consensus.cc:374] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.515491 8593 raft_consensus.cc:729] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50c41fe96f44907be9a851b05e4ae90, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.515529 8593 consensus_queue.cc:260] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.515609 8593 ts_tablet_manager.cc:1428] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.516070 8594 tablet_bootstrap.cc:492] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: No bootstrap required, opened a new log
I20260929 22:55:15.516120 8594 ts_tablet_manager.cc:1397] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:55:15.516304 8594 raft_consensus.cc:348] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.516376 8594 raft_consensus.cc:374] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.516397 8594 raft_consensus.cc:729] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.516443 8594 consensus_queue.cc:260] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.516526 8594 ts_tablet_manager.cc:1428] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.619119 8622 raft_consensus.cc:482] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:15.619236 8622 raft_consensus.cc:504] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.619444 8622 leader_election.cc:288] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.619709 8234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003bfc8fec0645aab27b14532c36ad49" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93279594ca664e948fea145eb3b9e962" is_pre_election: true
I20260929 22:55:15.619746 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003bfc8fec0645aab27b14532c36ad49" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90" is_pre_election: true
I20260929 22:55:15.619827 8519 raft_consensus.cc:2454] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 0.
I20260929 22:55:15.619845 8234 raft_consensus.cc:2454] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 0.
I20260929 22:55:15.619994 8307 leader_election.cc:302] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e50937c37c764f0cbc7a30835e8860bd, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:15.620100 8622 raft_consensus.cc:2781] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:15.620152 8622 raft_consensus.cc:482] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:15.620168 8622 raft_consensus.cc:3037] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.620934 8622 raft_consensus.cc:504] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.621085 8622 leader_election.cc:288] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 election: Requested vote from peers 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.621245 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003bfc8fec0645aab27b14532c36ad49" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90"
I20260929 22:55:15.621248 8234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003bfc8fec0645aab27b14532c36ad49" candidate_uuid: "e50937c37c764f0cbc7a30835e8860bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93279594ca664e948fea145eb3b9e962"
I20260929 22:55:15.621325 8234 raft_consensus.cc:3037] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.621326 8519 raft_consensus.cc:3037] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.622133 8519 raft_consensus.cc:2454] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 1.
I20260929 22:55:15.622133 8234 raft_consensus.cc:2454] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e50937c37c764f0cbc7a30835e8860bd in term 1.
I20260929 22:55:15.622328 8309 leader_election.cc:302] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, e50937c37c764f0cbc7a30835e8860bd; no voters:
I20260929 22:55:15.622447 8622 raft_consensus.cc:2781] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:15.622525 8622 raft_consensus.cc:686] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 1 LEADER]: Becoming Leader. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Running, Role: LEADER
I20260929 22:55:15.622586 8622 consensus_queue.cc:237] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.623131 8075 catalog_manager.cc:5495] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e50937c37c764f0cbc7a30835e8860bd (127.0.124.130). New cstate: current_term: 1 leader_uuid: "e50937c37c764f0cbc7a30835e8860bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:15.633059 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.630929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.0.124.130:35145)
0929 22:55:15.630968 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.630970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.631013 (+ 43us) server_negotiation.cc:407] Connection header received
0929 22:55:15.631070 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.631071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.631079 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.631124 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.631230 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.631702 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.632465 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.632641 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.632694 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.632824 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.632856 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.632905 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.632959 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.632983 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:15.633735 8519 raft_consensus.cc:1261] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Refusing update from remote peer e50937c37c764f0cbc7a30835e8860bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.633781 8234 raft_consensus.cc:1261] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Refusing update from remote peer e50937c37c764f0cbc7a30835e8860bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.633982 8622 consensus_queue.cc:1035] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.634095 8656 consensus_queue.cc:1035] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.636310 8075 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.636394 8075 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.636965 8075 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Sending DeleteTablet for 3 replicas of tablet 003bfc8fec0645aab27b14532c36ad49
I20260929 22:55:15.637233 8499 tablet_service.cc:1514] Processing DeleteTablet for tablet 003bfc8fec0645aab27b14532c36ad49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:34668
I20260929 22:55:15.637274 8213 tablet_service.cc:1514] Processing DeleteTablet for tablet 003bfc8fec0645aab27b14532c36ad49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60408
I20260929 22:55:15.637328 8343 tablet_service.cc:1514] Processing DeleteTablet for tablet 003bfc8fec0645aab27b14532c36ad49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:42576
I20260929 22:55:15.637348 8662 tablet_replica.cc:330] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: stopping tablet replica
I20260929 22:55:15.637398 8662 raft_consensus.cc:2229] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.637437 8662 raft_consensus.cc:2258] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.637549 8661 tablet_replica.cc:330] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: stopping tablet replica
I20260929 22:55:15.637609 8661 raft_consensus.cc:2229] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.637648 8661 raft_consensus.cc:2258] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.637727 8664 tablet_replica.cc:330] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: stopping tablet replica
I20260929 22:55:15.637743 8662 ts_tablet_manager.cc:1905] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.637787 8664 raft_consensus.cc:2229] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:15.637864 8664 raft_consensus.cc:2258] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.638177 8661 ts_tablet_manager.cc:1905] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.638324 8075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:15.638450 8075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:15.639281 8662 ts_tablet_manager.cc:1918] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:15.639348 8662 log.cc:1196] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/003bfc8fec0645aab27b14532c36ad49
I20260929 22:55:15.639523 8661 ts_tablet_manager.cc:1918] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:15.639582 8661 log.cc:1196] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/003bfc8fec0645aab27b14532c36ad49
I20260929 22:55:15.639611 8662 ts_tablet_manager.cc:1939] T 003bfc8fec0645aab27b14532c36ad49 P f50c41fe96f44907be9a851b05e4ae90: Deleting consensus metadata
I20260929 22:55:15.639799 8661 ts_tablet_manager.cc:1939] T 003bfc8fec0645aab27b14532c36ad49 P 93279594ca664e948fea145eb3b9e962: Deleting consensus metadata
I20260929 22:55:15.639914 8060 catalog_manager.cc:4841] TS f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361): tablet 003bfc8fec0645aab27b14532c36ad49 (table test-table [id=f12747dc9fcc457580bb6949e2858ac1]) successfully deleted
I20260929 22:55:15.640132 8062 catalog_manager.cc:4841] TS 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319): tablet 003bfc8fec0645aab27b14532c36ad49 (table test-table [id=f12747dc9fcc457580bb6949e2858ac1]) successfully deleted
I20260929 22:55:15.640178 8213 tablet_service.cc:1467] Processing CreateTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 (DEFAULT_TABLE table=test-table [id=e9630450227447a7ba56f47bc4999098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.640246 8499 tablet_service.cc:1467] Processing CreateTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 (DEFAULT_TABLE table=test-table [id=e9630450227447a7ba56f47bc4999098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.640305 8213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369afae86a8d4eb98ae8966bcfadc434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.640312 8343 tablet_service.cc:1467] Processing CreateTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 (DEFAULT_TABLE table=test-table [id=e9630450227447a7ba56f47bc4999098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:15.640345 8499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369afae86a8d4eb98ae8966bcfadc434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.640357 8664 ts_tablet_manager.cc:1905] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.640398 8343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369afae86a8d4eb98ae8966bcfadc434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:15.641484 8599 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: Bootstrap starting.
I20260929 22:55:15.641752 8599 tablet_bootstrap.cc:654] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.641781 8594 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Bootstrap starting.
I20260929 22:55:15.641791 8593 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Bootstrap starting.
I20260929 22:55:15.641904 8664 ts_tablet_manager.cc:1918] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:15.641949 8664 log.cc:1196] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/003bfc8fec0645aab27b14532c36ad49
I20260929 22:55:15.642081 8594 tablet_bootstrap.cc:654] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.642150 8664 ts_tablet_manager.cc:1939] T 003bfc8fec0645aab27b14532c36ad49 P e50937c37c764f0cbc7a30835e8860bd: Deleting consensus metadata
I20260929 22:55:15.642475 8593 tablet_bootstrap.cc:654] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:15.642745 8594 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: No bootstrap required, opened a new log
I20260929 22:55:15.642812 8594 ts_tablet_manager.cc:1397] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:15.642866 8062 catalog_manager.cc:4841] TS e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145): tablet 003bfc8fec0645aab27b14532c36ad49 (table test-table [id=f12747dc9fcc457580bb6949e2858ac1]) successfully deleted
I20260929 22:55:15.642941 8594 raft_consensus.cc:348] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.643021 8594 raft_consensus.cc:374] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.643038 8594 raft_consensus.cc:729] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e50937c37c764f0cbc7a30835e8860bd, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.643070 8593 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: No bootstrap required, opened a new log
I20260929 22:55:15.643097 8594 consensus_queue.cc:260] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.643119 8593 ts_tablet_manager.cc:1397] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:15.643199 8594 ts_tablet_manager.cc:1428] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.643260 8593 raft_consensus.cc:348] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.643342 8593 raft_consensus.cc:374] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.643373 8593 raft_consensus.cc:729] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50c41fe96f44907be9a851b05e4ae90, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.643422 8593 consensus_queue.cc:260] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.643528 8593 ts_tablet_manager.cc:1428] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.643927 8599 tablet_bootstrap.cc:492] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: No bootstrap required, opened a new log
I20260929 22:55:15.643985 8599 ts_tablet_manager.cc:1397] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260929 22:55:15.644090 8599 raft_consensus.cc:348] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.644160 8599 raft_consensus.cc:374] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:15.644186 8599 raft_consensus.cc:729] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Initialized, Role: FOLLOWER
I20260929 22:55:15.644286 8599 consensus_queue.cc:260] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.644399 8599 ts_tablet_manager.cc:1428] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:15.677722 8601 raft_consensus.cc:482] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:15.677834 8601 raft_consensus.cc:504] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.678016 8601 leader_election.cc:288] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.678179 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369afae86a8d4eb98ae8966bcfadc434" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd" is_pre_election: true
I20260929 22:55:15.678263 8377 raft_consensus.cc:2454] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:15.678194 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369afae86a8d4eb98ae8966bcfadc434" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90" is_pre_election: true
I20260929 22:55:15.678309 8519 raft_consensus.cc:2454] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 0.
I20260929 22:55:15.678427 8166 leader_election.cc:302] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, e50937c37c764f0cbc7a30835e8860bd; no voters:
I20260929 22:55:15.678534 8601 raft_consensus.cc:2781] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:15.678581 8601 raft_consensus.cc:482] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:15.678604 8601 raft_consensus.cc:3037] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.679284 8601 raft_consensus.cc:504] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.679425 8601 leader_election.cc:288] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Requested vote from peers e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145), f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361)
I20260929 22:55:15.679566 8519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369afae86a8d4eb98ae8966bcfadc434" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f50c41fe96f44907be9a851b05e4ae90"
I20260929 22:55:15.679602 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369afae86a8d4eb98ae8966bcfadc434" candidate_uuid: "93279594ca664e948fea145eb3b9e962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e50937c37c764f0cbc7a30835e8860bd"
I20260929 22:55:15.679649 8519 raft_consensus.cc:3037] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.679684 8377 raft_consensus.cc:3037] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:15.680297 8519 raft_consensus.cc:2454] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:15.680323 8377 raft_consensus.cc:2454] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93279594ca664e948fea145eb3b9e962 in term 1.
I20260929 22:55:15.680451 8164 leader_election.cc:302] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93279594ca664e948fea145eb3b9e962, f50c41fe96f44907be9a851b05e4ae90; no voters:
I20260929 22:55:15.680548 8601 raft_consensus.cc:2781] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:15.680599 8601 raft_consensus.cc:686] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 1 LEADER]: Becoming Leader. State: Replica: 93279594ca664e948fea145eb3b9e962, State: Running, Role: LEADER
I20260929 22:55:15.680681 8601 consensus_queue.cc:237] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } }
I20260929 22:55:15.681252 8073 catalog_manager.cc:5495] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93279594ca664e948fea145eb3b9e962 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "93279594ca664e948fea145eb3b9e962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93279594ca664e948fea145eb3b9e962" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260929 22:55:15.693581 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.691403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.0.124.129:38319)
0929 22:55:15.691446 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.691448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.691457 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:15.691502 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.691503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.691512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.691570 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.691658 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.692172 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.692907 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.693096 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.693152 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.693329 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.693355 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.693412 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.693484 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.693503 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:55:15.697139 8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.695346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:36921 (local address 127.0.124.129:38319)
0929 22:55:15.695377 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:15.695379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:15.695391 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:55:15.695432 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:15.695433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:15.695440 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:15.695482 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:15.695547 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.695936 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.696638 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.696803 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.696847 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.696948 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.696969 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.697019 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:15.697063 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 22:55:15.697075 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260929 22:55:15.697211 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.695295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.124.129:36921)
0929 22:55:15.695345 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.695354 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:15.695389 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:15.695483 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:15.695483 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:15.695484 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:55:15.695513 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.695514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.695984 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.695984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.696569 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:15.696571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:15.696855 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:15.696855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:15.696891 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:15.696896 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:55:15.697027 (+ 131us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:55:15.697028 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:55:15.697061 (+ 33us) client_negotiation.cc:240] Negotiation successful
0929 22:55:15.697095 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:55:15.699074 8519 raft_consensus.cc:1261] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.699219 8377 raft_consensus.cc:1261] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Refusing update from remote peer 93279594ca664e948fea145eb3b9e962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:15.699282 8646 consensus_queue.cc:1035] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f50c41fe96f44907be9a851b05e4ae90" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.699415 8646 consensus_queue.cc:1035] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e50937c37c764f0cbc7a30835e8860bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:15.708525 8075 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.708601 8075 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:15.709185 8075 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ddc728152384fff9abc758ce3b257f5: Sending DeleteTablet for 3 replicas of tablet 369afae86a8d4eb98ae8966bcfadc434
I20260929 22:55:15.709380 8213 tablet_service.cc:1514] Processing DeleteTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60408
I20260929 22:55:15.709431 8499 tablet_service.cc:1514] Processing DeleteTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:34668
I20260929 22:55:15.709499 8343 tablet_service.cc:1514] Processing DeleteTablet for tablet 369afae86a8d4eb98ae8966bcfadc434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:15 UTC) from {username='oryx', principal='oryx/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:42576
I20260929 22:55:15.709583 8661 tablet_replica.cc:330] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962: stopping tablet replica
I20260929 22:55:15.709645 8661 raft_consensus.cc:2229] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:15.709709 8661 raft_consensus.cc:2258] T 369afae86a8d4eb98ae8966bcfadc434 P 93279594ca664e948fea145eb3b9e962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.709744 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8147
I20260929 22:55:15.709792 8662 tablet_replica.cc:330] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: stopping tablet replica
I20260929 22:55:15.709846 8662 raft_consensus.cc:2229] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.709885 8662 raft_consensus.cc:2258] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.709951 8664 tablet_replica.cc:330] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: stopping tablet replica
I20260929 22:55:15.710001 8664 raft_consensus.cc:2229] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:15.710031 8664 raft_consensus.cc:2258] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:15.710484 8662 ts_tablet_manager.cc:1905] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.710796 8664 ts_tablet_manager.cc:1905] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:15.712118 8662 ts_tablet_manager.cc:1918] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:55:15.712177 8662 log.cc:1196] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/369afae86a8d4eb98ae8966bcfadc434
I20260929 22:55:15.712363 8664 ts_tablet_manager.cc:1918] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:55:15.712402 8664 log.cc:1196] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/369afae86a8d4eb98ae8966bcfadc434
I20260929 22:55:15.712428 8662 ts_tablet_manager.cc:1939] T 369afae86a8d4eb98ae8966bcfadc434 P f50c41fe96f44907be9a851b05e4ae90: Deleting consensus metadata
I20260929 22:55:15.712563 8664 ts_tablet_manager.cc:1939] T 369afae86a8d4eb98ae8966bcfadc434 P e50937c37c764f0cbc7a30835e8860bd: Deleting consensus metadata
I20260929 22:55:15.712754 8060 catalog_manager.cc:4841] TS f50c41fe96f44907be9a851b05e4ae90 (127.0.124.131:45361): tablet 369afae86a8d4eb98ae8966bcfadc434 (table test-table [id=e9630450227447a7ba56f47bc4999098]) successfully deleted
I20260929 22:55:15.712889 8062 catalog_manager.cc:4841] TS e50937c37c764f0cbc7a30835e8860bd (127.0.124.130:35145): tablet 369afae86a8d4eb98ae8966bcfadc434 (table test-table [id=e9630450227447a7ba56f47bc4999098]) successfully deleted
W20260929 22:55:15.716822 8062 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:38319 (error 108)
I20260929 22:55:15.717038 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8290
I20260929 22:55:15.719216 8691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:15.717222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38319 (local address 127.0.0.1:60456)
0929 22:55:15.719116 (+ 1894us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:15.719166 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1875,"thread_start_us":35,"threads_started":1}
W20260929 22:55:15.719372 8062 catalog_manager.cc:4584] TS 93279594ca664e948fea145eb3b9e962 (127.0.124.129:38319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 369afae86a8d4eb98ae8966bcfadc434: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38319: connect: Connection refused (error 111)
I20260929 22:55:15.723519 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8433
I20260929 22:55:15.727933 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8043
2026-09-29T22:55:15Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2801 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8694](info): set up 2 sockets
Sep 29 22:55:15 dist-test-slave-512q krb5kdc[8694](info): commencing operation
krb5kdc: starting...
W20260929 22:55:16.777097 498 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:16 dist-test-slave-512q krb5kdc[8694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:16.891119 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45969
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:45969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:16.970754 8707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:16.970975 8707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:16.971012 8707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:16.972123 8707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:16.972187 8707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:16.972208 8707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:16.972258 8707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:16.972287 8707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:16.973779 8707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:45969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:16.974044 8707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:16.974249 8707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:16.978989 8715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:16.979032 8712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:16.979032 8713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:16.979182 8707 server_base.cc:1034] running on GCE node
I20260929 22:55:16.979501 8707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:16.979772 8707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:16.980947 8707 hybrid_clock.cc:648] HybridClock initialized: now 1790722516980926 us; error 36 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-29T22:55:16Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1259 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:17 dist-test-slave-512q krb5kdc[8720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:17 dist-test-slave-512q krb5kdc[8720](info): set up 2 sockets
Sep 29 22:55:17 dist-test-slave-512q krb5kdc[8720](info): commencing operation
krb5kdc: starting...
W20260929 22:55:18.027029 498 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:18.138981 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44283
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:44283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:18.217111 8734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:18.217304 8734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:18.217325 8734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:18.218451 8734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:18.218499 8734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:18.218514 8734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:18.218526 8734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:18.218560 8734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:18.220046 8734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:44283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:18.220309 8734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:18.220532 8734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:18.225349 8739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.225550 8740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.225349 8742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:18.225878 8734 server_base.cc:1034] running on GCE node
I20260929 22:55:18.226145 8734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:18.226415 8734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:18.227568 8734 hybrid_clock.cc:648] HybridClock initialized: now 1790722518227565 us; error 37 us; skew 500 ppm
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:18.236312 8734 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:18.236824 8734 webserver.cc:460] Webserver started at http://127.0.124.190:38175/ using document root <none> and password file <none>
I20260929 22:55:18.237027 8734 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:18.237068 8734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:18.237156 8734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:18.238200 8734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "e14296d60b7048f5af9beb427069b726"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "ef75d219c2580ef0498e3da63d1d5ed1"
server_key_iv: "de6ac85f98a9f33bae5eab317044d298"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.238494 8734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "e14296d60b7048f5af9beb427069b726"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "ef75d219c2580ef0498e3da63d1d5ed1"
server_key_iv: "de6ac85f98a9f33bae5eab317044d298"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.239773 8734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:18.240512 8749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.240691 8734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:18.240794 8734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "e14296d60b7048f5af9beb427069b726"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "ef75d219c2580ef0498e3da63d1d5ed1"
server_key_iv: "de6ac85f98a9f33bae5eab317044d298"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.240868 8734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:18.254747 8734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:18.257085 8734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:18.257242 8734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:18.261116 8734 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:44283
I20260929 22:55:18.261152 8801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:44283 every 8 connection(s)
I20260929 22:55:18.261639 8734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:18.262270 8802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:18.262933 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8734
I20260929 22:55:18.263062 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:18.263247 498 external_mini_cluster.cc:1428] Setting key c55ff833e87224da63a4178c173774fb
I20260929 22:55:18.265324 8802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Bootstrap starting.
I20260929 22:55:18.266017 8802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:18.266301 8802 log.cc:824] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:18.267016 8802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: No bootstrap required, opened a new log
I20260929 22:55:18.269171 8802 raft_consensus.cc:348] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.269299 8802 raft_consensus.cc:374] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:18.269320 8802 raft_consensus.cc:729] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14296d60b7048f5af9beb427069b726, State: Initialized, Role: FOLLOWER
I20260929 22:55:18.269455 8802 consensus_queue.cc:260] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.269603 8802 raft_consensus.cc:388] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:18.269640 8802 raft_consensus.cc:482] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:18.269702 8802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:18.270229 8802 raft_consensus.cc:504] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:18.270316 8802 leader_election.cc:302] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e14296d60b7048f5af9beb427069b726; no voters:
I20260929 22:55:18.270569 8802 leader_election.cc:288] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:18.270618 8807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:18.270784 8807 raft_consensus.cc:686] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 LEADER]: Becoming Leader. State: Replica: e14296d60b7048f5af9beb427069b726, State: Running, Role: LEADER
I20260929 22:55:18.270820 8802 sys_catalog.cc:564] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:18.270956 8807 consensus_queue.cc:237] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.271427 8808 sys_catalog.cc:455] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e14296d60b7048f5af9beb427069b726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } } }
I20260929 22:55:18.271591 8808 sys_catalog.cc:458] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:18.271806 8809 sys_catalog.cc:455] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e14296d60b7048f5af9beb427069b726. Latest consensus state: current_term: 1 leader_uuid: "e14296d60b7048f5af9beb427069b726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } } }
I20260929 22:55:18.271939 8809 sys_catalog.cc:458] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:18.272076 8816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:18.272658 8816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:18.274338 8816 catalog_manager.cc:1347] Generated new cluster ID: 7ea4c37a294e4af397d3860b069f660e
I20260929 22:55:18.274381 8816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:18.274595 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.263767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.0.124.190:44283)
0929 22:55:18.263971 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:18.263981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:18.264013 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:55:18.264598 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:18.264606 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:18.264676 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:18.264826 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:18.265393 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.266738 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.267527 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.268152 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.268296 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.270855 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:18.270860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:18.270860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:18.270871 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:18.272992 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.273426 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.273429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.273430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.273527 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.273728 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.273729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.273729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.274037 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:18.274189 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:18.274298 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 22:55:18.274441 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":76,"threads_started":1}
I20260929 22:55:18.284920 8816 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:18.285517 8816 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:18.288497 8816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Generated new TSK 0
I20260929 22:55:18.288654 8816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:55:18.315357 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:18.394100 8828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:18.394315 8828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:18.394348 8828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:18.395481 8828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:18.395543 8828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:18.395587 8828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:18.397091 8828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:18.397343 8828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:18.397553 8828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:18.403157 8833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.403179 8834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.403404 8836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:18.403678 8828 server_base.cc:1034] running on GCE node
I20260929 22:55:18.403906 8828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:18.404150 8828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:18.405300 8828 hybrid_clock.cc:648] HybridClock initialized: now 1790722518405288 us; error 26 us; skew 500 ppm
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:18.407604 8828 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:55:18.408092 8828 webserver.cc:460] Webserver started at http://127.0.124.129:34471/ using document root <none> and password file <none>
I20260929 22:55:18.408344 8828 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:18.408397 8828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:18.408541 8828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:18.409587 8828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "88e1a85eba6d4ffeb9cc4b1e60f3784a"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "6bfca00334fff0bc5a7911e69b4c6907"
server_key_iv: "2e7a7ed342b981108ad09dcb3c5d381c"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.410018 8828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "88e1a85eba6d4ffeb9cc4b1e60f3784a"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "6bfca00334fff0bc5a7911e69b4c6907"
server_key_iv: "2e7a7ed342b981108ad09dcb3c5d381c"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.411347 8828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:55:18.412106 8843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.412343 8828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:18.412468 8828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "88e1a85eba6d4ffeb9cc4b1e60f3784a"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "6bfca00334fff0bc5a7911e69b4c6907"
server_key_iv: "2e7a7ed342b981108ad09dcb3c5d381c"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.412537 8828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:18.430028 8828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:18.432087 8828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:18.432262 8828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:18.432487 8828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:18.432781 8828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:18.432812 8828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.432861 8828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:18.432886 8828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.438337 8828 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:36375
I20260929 22:55:18.438375 8957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:36375 every 8 connection(s)
I20260929 22:55:18.438690 8828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:18.440373 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8828
I20260929 22:55:18.440496 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:18.440693 498 external_mini_cluster.cc:1428] Setting key 41d68a291ed5da9670533bccb166432d
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
I20260929 22:55:18.448338 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.439361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:44689 (local address 127.0.124.190:44283)
0929 22:55:18.439443 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:18.439446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:18.439692 (+ 246us) server_negotiation.cc:407] Connection header received
0929 22:55:18.440841 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:18.440842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:18.440857 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:18.440941 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:18.441580 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.442063 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.443229 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.443483 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.443568 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.445685 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:18.445687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:18.445687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:18.445695 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:18.447022 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.447404 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.447405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.447406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.447461 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.447702 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.447702 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.447703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.447809 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:18.447875 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:18.448140 (+ 265us) server_negotiation.cc:299] Negotiation successful
0929 22:55:18.448250 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:18.448506 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.439357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:44689)
0929 22:55:18.439549 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:18.439582 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:18.440702 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:18.440994 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:18.440997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:18.441215 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:18.441492 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.441499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.442144 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.442145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.443130 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.443132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.443575 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.443576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.443694 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.444157 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:18.444165 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:18.445596 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:18.447110 (+ 1514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.447116 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.447117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.447325 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.447521 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.447522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.447523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.447627 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.447875 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:18.447882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:18.448011 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 22:55:18.448107 (+ 96us) client_negotiation.cc:240] Negotiation successful
0929 22:55:18.448272 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":104,"threads_started":1}
I20260929 22:55:18.448951 8958 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44283
I20260929 22:55:18.449035 8958 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:18.449218 8958 heartbeater.cc:511] Master 127.0.124.190:44283 requested a full tablet report, sending...
I20260929 22:55:18.449704 8766 ts_manager.cc:194] Registered new tserver with Master: 88e1a85eba6d4ffeb9cc4b1e60f3784a (127.0.124.129:36375)
I20260929 22:55:18.450328 8766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:44689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:18.464496 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:18.543234 8963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:18.543444 8963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:18.543481 8963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:18.544694 8963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:18.544752 8963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:18.544793 8963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:18.546228 8963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:18.546500 8963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:18.546715 8963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:18.551378 8971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.551437 8969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.551383 8968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:18.551623 8963 server_base.cc:1034] running on GCE node
I20260929 22:55:18.551834 8963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:18.552057 8963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:18.553189 8963 hybrid_clock.cc:648] HybridClock initialized: now 1790722518553175 us; error 30 us; skew 500 ppm
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:18.555593 8963 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:18.556077 8963 webserver.cc:460] Webserver started at http://127.0.124.130:44747/ using document root <none> and password file <none>
I20260929 22:55:18.556337 8963 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:18.556382 8963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:18.556530 8963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:18.557499 8963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "2ae909b70d124124a8e81ecb77e9cda8"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "932ddb38176cbf90aa62a6b1c7f33b66"
server_key_iv: "043abdeef71c136c1df5d3983f585dcf"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.557825 8963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "2ae909b70d124124a8e81ecb77e9cda8"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "932ddb38176cbf90aa62a6b1c7f33b66"
server_key_iv: "043abdeef71c136c1df5d3983f585dcf"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.559098 8963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:18.559881 8978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.560061 8963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:18.560148 8963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "2ae909b70d124124a8e81ecb77e9cda8"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "932ddb38176cbf90aa62a6b1c7f33b66"
server_key_iv: "043abdeef71c136c1df5d3983f585dcf"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.560230 8963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:18.569209 8963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:18.571473 8963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:18.571619 8963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:18.571835 8963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:18.572120 8963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:18.572151 8963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.572183 8963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:18.572276 8963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.577881 8963 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:43473
I20260929 22:55:18.577930 9092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:43473 every 8 connection(s)
I20260929 22:55:18.578202 8963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:18.578655 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 8963
I20260929 22:55:18.578784 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:18.579010 498 external_mini_cluster.cc:1428] Setting key b907f1123d4695ba80488c9bedd9114c
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:55:18.587543 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.578882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55977 (local address 127.0.124.190:44283)
0929 22:55:18.578935 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:18.578937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:18.579159 (+ 222us) server_negotiation.cc:407] Connection header received
0929 22:55:18.580366 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:18.580367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:18.580380 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:18.580476 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:18.581088 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.581584 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.582590 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.582760 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.582835 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.584944 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:18.584946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:18.584946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:18.584958 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:18.586250 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.586643 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.586644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.586645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.586701 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.586947 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.586948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.586948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.587050 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:18.587115 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:18.587373 (+ 258us) server_negotiation.cc:299] Negotiation successful
0929 22:55:18.587448 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:18.587743 9095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.578885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:55977)
0929 22:55:18.579033 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:18.579071 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:18.580262 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:18.580532 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:18.580535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:18.580765 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:18.580990 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.580996 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.581662 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.581663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.582516 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.582519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.582841 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.582842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.582974 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.583463 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:18.583470 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:18.584839 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:18.586331 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.586337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.586339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.586559 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.586764 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.586765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.586766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.586870 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.587119 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:18.587125 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:18.587251 (+ 126us) client_negotiation.cc:769] Sending connection context
0929 22:55:18.587352 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 22:55:18.587513 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":94,"threads_started":1}
I20260929 22:55:18.588260 9093 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44283
I20260929 22:55:18.588363 9093 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:18.588547 9093 heartbeater.cc:511] Master 127.0.124.190:44283 requested a full tablet report, sending...
I20260929 22:55:18.588874 8766 ts_manager.cc:194] Registered new tserver with Master: 2ae909b70d124124a8e81ecb77e9cda8 (127.0.124.130:43473)
I20260929 22:55:18.589211 8766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:55977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:18.604280 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:18.683444 9098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:18.683655 9098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:18.683677 9098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:18.684823 9098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:18.684865 9098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:18.684892 9098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:18.686299 9098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:18.686475 9098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:18.686648 9098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:55:18.691579 9098 server_base.cc:1034] running on GCE node
W20260929 22:55:18.691525 9106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.691524 9104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.691535 9103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:18.692008 9098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:18.692239 9098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:18.693459 9098 hybrid_clock.cc:648] HybridClock initialized: now 1790722518693436 us; error 30 us; skew 500 ppm
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:18.696039 9098 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:18.696506 9098 webserver.cc:460] Webserver started at http://127.0.124.131:36759/ using document root <none> and password file <none>
I20260929 22:55:18.696697 9098 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:18.696741 9098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:18.696841 9098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:18.697849 9098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "99710e9890f546d9a4323e701716c7c1"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "09c453983b6cd0e9ee8624fc396b8b0f"
server_key_iv: "f4d6b70bba7a19956da4299ecd500ce8"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.698169 9098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "99710e9890f546d9a4323e701716c7c1"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "09c453983b6cd0e9ee8624fc396b8b0f"
server_key_iv: "f4d6b70bba7a19956da4299ecd500ce8"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.699506 9098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:18.700142 9113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.700320 9098 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:18.700418 9098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "99710e9890f546d9a4323e701716c7c1"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "09c453983b6cd0e9ee8624fc396b8b0f"
server_key_iv: "f4d6b70bba7a19956da4299ecd500ce8"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.700498 9098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:18.740049 9098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:18.741997 9098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:18.742159 9098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:18.742395 9098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:18.742717 9098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:18.742774 9098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.742815 9098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:18.742843 9098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.748541 9098 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35617
I20260929 22:55:18.748607 9227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35617 every 8 connection(s)
I20260929 22:55:18.748943 9098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:18.749248 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9098
I20260929 22:55:18.749351 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:18.749538 498 external_mini_cluster.cc:1428] Setting key 23ee79b21146fac3c4ac0ed61341a125
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:18.757812 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.749702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:41557 (local address 127.0.124.190:44283)
0929 22:55:18.749758 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:18.749760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:18.749979 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:55:18.751075 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:18.751076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:18.751086 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:18.751131 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:18.751704 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.752192 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.753190 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.753375 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.753425 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.755490 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:18.755491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:18.755492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:18.755498 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:18.756719 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.757073 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.757074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.757074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.757125 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:18.757320 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:18.757321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:18.757321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:18.757416 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:18.757465 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:18.757687 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 22:55:18.757746 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:55:18.758025 9230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:18.749671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:41557)
0929 22:55:18.749839 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:18.749888 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:18.750977 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:18.751186 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:18.751190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:18.751440 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:18.751638 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.751642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.752317 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.752318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.753120 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:18.753122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:18.753440 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:18.753441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:18.753546 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:18.754080 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:18.754088 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:18.755399 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:18.756787 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.756792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.756794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.757007 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.757179 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:18.757179 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:18.757180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:18.757271 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:18.757466 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:18.757469 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:18.757586 (+ 117us) client_negotiation.cc:769] Sending connection context
0929 22:55:18.757666 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:55:18.757777 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260929 22:55:18.758496 9228 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44283
I20260929 22:55:18.758605 9228 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:18.758792 9228 heartbeater.cc:511] Master 127.0.124.190:44283 requested a full tablet report, sending...
I20260929 22:55:18.759140 8766 ts_manager.cc:194] Registered new tserver with Master: 99710e9890f546d9a4323e701716c7c1 (127.0.124.131:35617)
I20260929 22:55:18.759506 8766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:41557
I20260929 22:55:18.761188 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
Entry for principal oryx/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab.
WARNING: no policy specified for oryx/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
Entry for principal oryx/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab.
WARNING: no policy specified for oryx/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
Entry for principal oryx/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab.
I20260929 22:55:18.826988 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8828
I20260929 22:55:18.831401 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8963
I20260929 22:55:18.835805 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9098
I20260929 22:55:18.839782 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 8734
I20260929 22:55:18.844847 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44283
--webserver_interface=127.0.124.190
--webserver_port=38175
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:44283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:18.926256 9237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:18.926474 9237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:18.926497 9237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:18.927673 9237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:18.927719 9237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:18.927736 9237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:18.927750 9237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:18.927800 9237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:18.929316 9237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:44283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=38175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:18.929576 9237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:18.929795 9237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:18.934636 9246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.934660 9244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:18.934659 9243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:18.934818 9237 server_base.cc:1034] running on GCE node
I20260929 22:55:18.935038 9237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:18.935325 9237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:18.936486 9237 hybrid_clock.cc:648] HybridClock initialized: now 1790722518936473 us; error 40 us; skew 500 ppm
Sep 29 22:55:18 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722518, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:18.938829 9237 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:18.939280 9237 webserver.cc:460] Webserver started at http://127.0.124.190:38175/ using document root <none> and password file <none>
I20260929 22:55:18.939515 9237 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:18.939590 9237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:18.940935 9237 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:55:18.941565 9253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:18.941715 9237 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:18.941809 9237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "e14296d60b7048f5af9beb427069b726"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "ef75d219c2580ef0498e3da63d1d5ed1"
server_key_iv: "de6ac85f98a9f33bae5eab317044d298"
server_key_version: "encryptionkey@0"
I20260929 22:55:18.942132 9237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:18.973142 9237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:18.975044 9237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:18.975209 9237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:18.979115 9237 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:44283
I20260929 22:55:18.979151 9305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:44283 every 8 connection(s)
I20260929 22:55:18.979722 9237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:18.981096 9306 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:55:18.981689 9306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Bootstrap starting.
I20260929 22:55:18.989378 9306 log.cc:824] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:18.989797 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9237
I20260929 22:55:18.990103 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:36375
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:44283
--webserver_port=34471
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:55:18.991209 9306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:55:18.991497 9306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Bootstrap complete.
I20260929 22:55:18.995210 9306 raft_consensus.cc:348] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.995582 9306 raft_consensus.cc:729] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14296d60b7048f5af9beb427069b726, State: Initialized, Role: FOLLOWER
I20260929 22:55:18.995769 9306 consensus_queue.cc:260] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.995849 9306 raft_consensus.cc:388] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:18.995903 9306 raft_consensus.cc:482] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:18.995958 9306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:55:18.997543 9306 raft_consensus.cc:504] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.997668 9306 leader_election.cc:302] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e14296d60b7048f5af9beb427069b726; no voters:
I20260929 22:55:18.997839 9306 leader_election.cc:288] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:55:18.997898 9310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:55:18.998092 9310 raft_consensus.cc:686] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [term 2 LEADER]: Becoming Leader. State: Replica: e14296d60b7048f5af9beb427069b726, State: Running, Role: LEADER
I20260929 22:55:18.998127 9306 sys_catalog.cc:564] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:18.998193 9310 consensus_queue.cc:237] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } }
I20260929 22:55:18.998505 9310 sys_catalog.cc:455] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e14296d60b7048f5af9beb427069b726. Latest consensus state: current_term: 2 leader_uuid: "e14296d60b7048f5af9beb427069b726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } } }
I20260929 22:55:18.998505 9311 sys_catalog.cc:455] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e14296d60b7048f5af9beb427069b726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e14296d60b7048f5af9beb427069b726" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44283 } } }
I20260929 22:55:18.998656 9310 sys_catalog.cc:458] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:18.998672 9311 sys_catalog.cc:458] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:18.998832 9317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:18.999512 9317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:18.999724 9317 catalog_manager.cc:1259] Loaded cluster ID: 7ea4c37a294e4af397d3860b069f660e
I20260929 22:55:18.999946 9317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:19.001379 9317 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:19.001546 9317 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e14296d60b7048f5af9beb427069b726: Loaded TSK: 0
I20260929 22:55:19.001746 9317 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:55:19.072517 9309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:19.072711 9309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:19.072733 9309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:19.073879 9309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:19.073925 9309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:19.073951 9309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:19.075335 9309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.129.keytab
--principal=oryx/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:36375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=34471
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:19.075552 9309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:19.075764 9309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:19.081748 9333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:19.081854 9309 server_base.cc:1034] running on GCE node
W20260929 22:55:19.081785 9335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:19.081992 9332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:19.082211 9309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:19.082515 9309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:19.083674 9309 hybrid_clock.cc:648] HybridClock initialized: now 1790722519083655 us; error 36 us; skew 500 ppm
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722519, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:19.086647 9309 init.cc:377] Logged in from keytab as oryx/127.0.124.129@KRBTEST.COM (short username oryx)
I20260929 22:55:19.087105 9309 webserver.cc:460] Webserver started at http://127.0.124.129:34471/ using document root <none> and password file <none>
I20260929 22:55:19.087335 9309 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:19.087422 9309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:19.088827 9309 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:19.089465 9342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.089630 9309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:19.089713 9309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "88e1a85eba6d4ffeb9cc4b1e60f3784a"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "6bfca00334fff0bc5a7911e69b4c6907"
server_key_iv: "2e7a7ed342b981108ad09dcb3c5d381c"
server_key_version: "encryptionkey@0"
I20260929 22:55:19.090055 9309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:19.105696 9309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:19.107990 9309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:19.108148 9309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:19.108417 9309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:19.108731 9309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:19.108778 9309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.108819 9309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:19.108844 9309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.114871 9309 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:36375
I20260929 22:55:19.114928 9458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:36375 every 8 connection(s)
I20260929 22:55:19.115253 9309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:19.115561 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9309
I20260929 22:55:19.115870 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:43473
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:44283
--webserver_port=44747
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.125618 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.115957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:42983)
0929 22:55:19.116396 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.116428 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.116867 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.117667 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.117671 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.118452 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.118632 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.118637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.120332 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.120333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.121451 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.121454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.122371 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.122372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.122506 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.123154 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.123164 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.125449 (+ 2285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":93,"threads_started":1}
W20260929 22:55:19.125838 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.115987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:42983 (local address 127.0.124.190:44283)
0929 22:55:19.117018 (+ 1031us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.117024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.117049 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:55:19.117176 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.117183 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.117242 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.117512 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.118749 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.120224 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.121554 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.122274 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.122390 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.125645 (+ 3255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:42983: BlockingRecv error: recv got EOF from 127.0.124.129:42983 (error 108)
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":70,"threads_started":1}
W20260929 22:55:19.125847 9459 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:44283 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.124.190:44283: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.131013 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.126057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:59899)
0929 22:55:19.126169 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.126179 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.126225 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.126395 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.126396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.126530 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.126575 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.126577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.127568 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.127569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.128071 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.128072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.128540 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.128540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.128590 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.129015 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.129019 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.130884 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260929 22:55:19.131165 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.126109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:59899 (local address 127.0.124.190:44283)
0929 22:55:19.126184 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.126186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.126214 (+ 28us) server_negotiation.cc:407] Connection header received
0929 22:55:19.126267 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.126269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.126282 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.126349 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.126645 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.127484 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.128148 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.128476 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.128542 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.131101 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:59899: BlockingRecv error: recv got EOF from 127.0.124.129:59899 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.135439 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.131475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:41335)
0929 22:55:19.131524 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.131535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.131574 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.131716 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.131716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.131834 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.131857 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.131858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.132504 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.132505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.132998 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.132999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.133327 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.133328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.133376 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.133791 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.133795 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.135373 (+ 1578us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:55:19.135545 9459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:55:19.135565 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.131535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41335 (local address 127.0.124.190:44283)
0929 22:55:19.131576 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.131578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.131586 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:19.131627 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.131628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.131639 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.131700 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.131925 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.132432 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.133089 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.133262 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.133331 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.135494 (+ 2163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:41335: BlockingRecv error: recv got EOF from 127.0.124.129:41335 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:55:19.201206 9463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:19.201426 9463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:19.201463 9463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:19.202608 9463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:19.202670 9463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:19.202710 9463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:19.204114 9463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.130.keytab
--principal=oryx/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:43473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=44747
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:19.204380 9463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:19.204597 9463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:19.209736 9468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:19.209821 9471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:19.209766 9469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:19.209949 9463 server_base.cc:1034] running on GCE node
I20260929 22:55:19.210172 9463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:19.210371 9463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:19.211506 9463 hybrid_clock.cc:648] HybridClock initialized: now 1790722519211491 us; error 30 us; skew 500 ppm
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722519, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:19.214118 9463 init.cc:377] Logged in from keytab as oryx/127.0.124.130@KRBTEST.COM (short username oryx)
I20260929 22:55:19.214571 9463 webserver.cc:460] Webserver started at http://127.0.124.130:44747/ using document root <none> and password file <none>
I20260929 22:55:19.214771 9463 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:19.214825 9463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:19.216171 9463 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:19.216851 9479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.217015 9463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.217092 9463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "2ae909b70d124124a8e81ecb77e9cda8"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "932ddb38176cbf90aa62a6b1c7f33b66"
server_key_iv: "043abdeef71c136c1df5d3983f585dcf"
server_key_version: "encryptionkey@0"
I20260929 22:55:19.217401 9463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:19.251274 9463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:19.254257 9463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:19.254419 9463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:19.254752 9463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:19.255156 9463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:19.255208 9463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.255247 9463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:19.255285 9463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.263404 9463 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:43473
I20260929 22:55:19.263471 9593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:43473 every 8 connection(s)
I20260929 22:55:19.263896 9463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:55:19.271272 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.264758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55321 (local address 127.0.124.190:44283)
0929 22:55:19.264798 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.264800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.265066 (+ 266us) server_negotiation.cc:407] Connection header received
0929 22:55:19.265579 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.265580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.265596 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.265659 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.266582 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.267077 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.268069 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.268362 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.268445 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.271215 (+ 2770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:55321: BlockingRecv error: recv got EOF from 127.0.124.130:55321 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:55:19.271339 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.264780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:55321)
0929 22:55:19.264948 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.264983 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.265482 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.265733 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.265736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.266282 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.266478 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.266483 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.267164 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.267165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.267966 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.267968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.268454 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.268455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.268578 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.269084 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.269093 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.271142 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
W20260929 22:55:19.271600 9594 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:44283 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.124.190:44283: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
I20260929 22:55:19.272488 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9463
I20260929 22:55:19.272765 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:35617
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:44283
--webserver_port=36759
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:55:19.276834 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.271879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:46683 (local address 127.0.124.190:44283)
0929 22:55:19.271941 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.271943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.271950 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:55:19.271987 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.271988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.271995 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.272040 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.272378 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.272917 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.273764 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.273986 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.274082 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.276789 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:46683: BlockingRecv error: recv got EOF from 127.0.124.130:46683 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:19.276836 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.271819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:46683)
0929 22:55:19.271878 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.271890 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.271936 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.272042 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.272043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.272149 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.272192 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.272193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.273035 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.273036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.273649 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.273651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.274091 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.274092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.274166 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.274636 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.274641 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.276721 (+ 2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.282094 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.277140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:53093)
0929 22:55:19.277269 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.277282 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.277354 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.277495 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.277496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.277668 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.277708 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.277710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.278291 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.278293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.279279 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.279281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.279633 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.279635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.279703 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.280079 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.280085 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.282018 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260929 22:55:19.282148 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.277230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:53093 (local address 127.0.124.190:44283)
0929 22:55:19.277277 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.277278 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.277340 (+ 62us) server_negotiation.cc:407] Connection header received
0929 22:55:19.277432 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.277433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.277440 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.277485 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.277781 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.278217 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.279393 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.279560 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.279608 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.282091 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:53093: BlockingRecv error: recv got EOF from 127.0.124.130:53093 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260929 22:55:19.282262 9594 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:55:19.360352 9597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:19.360591 9597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:19.360644 9597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:19.361783 9597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:19.361846 9597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:19.361886 9597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:19.363230 9597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/krb5kdc/oryx_127.0.124.131.keytab
--principal=oryx/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:35617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=36759
--tserver_master_addrs=127.0.124.190:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:19.363495 9597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:19.363704 9597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:19.368678 9602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:19.368672 9603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:19.368731 9597 server_base.cc:1034] running on GCE node
W20260929 22:55:19.368672 9605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:19.369119 9597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:19.369352 9597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:19.370483 9597 hybrid_clock.cc:648] HybridClock initialized: now 1790722519370466 us; error 36 us; skew 500 ppm
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722519, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:19.372824 9597 init.cc:377] Logged in from keytab as oryx/127.0.124.131@KRBTEST.COM (short username oryx)
I20260929 22:55:19.373297 9597 webserver.cc:460] Webserver started at http://127.0.124.131:36759/ using document root <none> and password file <none>
I20260929 22:55:19.373471 9597 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:19.373522 9597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:19.374744 9597 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:19.375270 9612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.375437 9597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.375515 9597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "99710e9890f546d9a4323e701716c7c1"
format_stamp: "Formatted at 2026-09-29 22:55:18 on dist-test-slave-512q"
server_key: "09c453983b6cd0e9ee8624fc396b8b0f"
server_key_iv: "f4d6b70bba7a19956da4299ecd500ce8"
server_key_version: "encryptionkey@0"
I20260929 22:55:19.375830 9597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:19.391453 9597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:19.393492 9597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:19.393638 9597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:19.393858 9597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:19.394162 9597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:19.394194 9597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.394215 9597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:19.394254 9597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:19.400141 9597 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35617
I20260929 22:55:19.400234 9728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35617 every 8 connection(s)
I20260929 22:55:19.400600 9597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:55:19.407683 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.401330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:50837 (local address 127.0.124.190:44283)
0929 22:55:19.401377 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.401379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.401570 (+ 191us) server_negotiation.cc:407] Connection header received
0929 22:55:19.402093 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.402094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.402106 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.402161 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.403096 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.403588 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.404624 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.404818 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.404897 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.407608 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:50837: BlockingRecv error: recv got EOF from 127.0.124.131:50837 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:19.407758 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.401308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:50837)
0929 22:55:19.401443 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.401485 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.401979 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.402231 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.402234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.402806 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.403000 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.403004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.403693 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.403694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.404534 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.404536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.404907 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.404908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.405038 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.405490 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.405499 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.407548 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":62,"threads_started":1}
W20260929 22:55:19.407948 9729 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:44283 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.124.190:44283: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
I20260929 22:55:19.408128 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9597
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.412505 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.408165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:40085)
0929 22:55:19.408228 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.408238 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.408276 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.408576 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.408577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.408732 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.408786 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.408787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.409396 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.409397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.409952 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.409954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.410265 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.410266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.410329 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.410703 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.410708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.412459 (+ 1751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 22:55:19.412632 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.408368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:40085 (local address 127.0.124.190:44283)
0929 22:55:19.408413 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.408414 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.408421 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:55:19.408437 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.408438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.408445 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.408550 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.408868 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.409328 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.410027 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.410201 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.410249 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.412563 (+ 2314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:40085: BlockingRecv error: recv got EOF from 127.0.124.131:40085 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:19.415541 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.408567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33404 (local address 127.0.124.190:44283)
0929 22:55:19.408673 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.408675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.408742 (+ 67us) server_negotiation.cc:407] Connection header received
0929 22:55:19.408811 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.408811 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.408819 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.408908 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.409455 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.409864 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.410843 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.411033 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.411083 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.412332 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:19.412336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:19.412336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:19.412346 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:19.414100 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:19.414410 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:19.414413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:19.414413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:19.414534 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:19.414720 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:19.414721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:19.414721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:19.414959 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:19.415124 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:19.415225 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 22:55:19.415307 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":59,"threads_started":1}
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:19 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:19.417249 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:19.412908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:47055)
0929 22:55:19.412977 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:19.412992 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:19.413046 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:19.413188 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:19.413189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:19.413325 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:19.413357 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.413359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.413930 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.413931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.414640 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:19.414642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.415014 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.415015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:19.415065 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.415450 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:19.415455 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:19.417174 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 22:55:19.417290 9462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:19.412984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:47055 (local address 127.0.124.190:44283)
0929 22:55:19.413035 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:19.413037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:19.413046 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:19.413104 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:19.413105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:19.413114 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:19.413171 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:19.413440 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.413859 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.414729 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:19.414944 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:19.414996 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:19.417235 (+ 2239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:47055: BlockingRecv error: recv got EOF from 127.0.124.131:47055 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260929 22:55:19.417392 9729 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:20.140538 9734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:20.135922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:41003)
0929 22:55:20.136056 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:20.136065 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:20.136105 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:20.136329 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:20.136330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:20.136481 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:20.136524 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.136526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.137315 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.137315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.137818 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.137820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.138150 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.138150 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.138188 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.138651 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:20.138654 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:20.140469 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":55,"threads_started":1}
W20260929 22:55:20.140600 9735 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:20.136032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41003 (local address 127.0.124.190:44283)
0929 22:55:20.136164 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:20.136166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:20.136175 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:20.136198 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:20.136199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:20.136240 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:20.136318 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:20.136592 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.137255 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.137897 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.138085 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.138143 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.140549 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:41003: BlockingRecv error: recv got EOF from 127.0.124.129:41003 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:20.287067 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:20.282559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:54357)
0929 22:55:20.282670 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:20.282680 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:20.282724 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:20.282924 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:20.282925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:20.283096 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:20.283138 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.283140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.283852 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.283853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.284429 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.284431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.284799 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.284800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.284860 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.285301 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:20.285306 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:20.286951 (+ 1645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":64,"threads_started":1}
W20260929 22:55:20.287117 9735 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:20.282768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:54357 (local address 127.0.124.190:44283)
0929 22:55:20.282824 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:20.282826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:20.282832 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:55:20.282849 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:20.282850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:20.282860 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:20.282918 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:20.283212 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.283774 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.284516 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.284707 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.284799 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.287032 (+ 2233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:54357: BlockingRecv error: recv got EOF from 127.0.124.130:54357 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:20 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:20.422446 9737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:20.417736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:43929)
0929 22:55:20.417884 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:20.417896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:20.417976 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:20.418141 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:20.418142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:20.418321 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:20.418367 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.418368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.419032 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.419033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.419637 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:20.419639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.419996 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.419997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:20.420055 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.420576 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:20.420583 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:20.422342 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
W20260929 22:55:20.422497 9735 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:20.417807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:43929 (local address 127.0.124.190:44283)
0929 22:55:20.417869 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:20.417871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:20.417956 (+ 85us) server_negotiation.cc:407] Connection header received
0929 22:55:20.418050 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:20.418051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:20.418065 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:20.418135 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:20.418448 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.418948 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.419716 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:20.419911 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:20.419990 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:20.422425 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:43929: BlockingRecv error: recv got EOF from 127.0.124.131:43929 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:21.145663 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:21.140997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:47393)
0929 22:55:21.141133 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:21.141144 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:21.141206 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:21.141331 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:21.141332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:21.141487 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:21.141533 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.141535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.142138 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.142139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.142675 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.142677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.143011 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.143012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.143072 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.143660 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:21.143665 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:21.145569 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
W20260929 22:55:21.145707 9739 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:21.141092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:47393 (local address 127.0.124.190:44283)
0929 22:55:21.141190 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:21.141192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:21.141201 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:21.141251 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:21.141252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:21.141262 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:21.141319 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:21.141590 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.142068 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.142748 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.142932 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.142986 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.145639 (+ 2653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:47393: BlockingRecv error: recv got EOF from 127.0.124.129:47393 (error 108)
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":44,"threads_started":1}
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:21.291939 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:21.287475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:39045)
0929 22:55:21.287628 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:21.287640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:21.287706 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:21.287843 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:21.287843 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:21.288022 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:21.288067 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.288069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.288765 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.288766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.289292 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.289293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.289658 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.289658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.289722 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.290156 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:21.290160 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:21.291873 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
W20260929 22:55:21.292064 9739 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:21.287564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:39045 (local address 127.0.124.190:44283)
0929 22:55:21.287629 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:21.287631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:21.287687 (+ 56us) server_negotiation.cc:407] Connection header received
0929 22:55:21.287760 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:21.287761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:21.287772 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:21.287837 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:21.288143 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.288687 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.289387 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.289583 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.289649 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.291963 (+ 2314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:39045: BlockingRecv error: recv got EOF from 127.0.124.130:39045 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:21 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:21.427242 9742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:21.422886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:37129)
0929 22:55:21.423033 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:21.423042 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:21.423094 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:21.423224 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:21.423225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:21.423404 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:21.423451 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.423453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.424049 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.424050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.424592 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:21.424593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.424887 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.424888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:21.424924 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.425347 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:21.425352 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:21.427187 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
W20260929 22:55:21.427377 9739 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:21.422991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:37129 (local address 127.0.124.190:44283)
0929 22:55:21.423055 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:21.423057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:21.423082 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:55:21.423145 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:21.423146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:21.423157 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:21.423207 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:21.423526 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.423990 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.424656 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:21.424829 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:21.424880 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:21.427295 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:37129: BlockingRecv error: recv got EOF from 127.0.124.131:37129 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:22.150380 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:22.146127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:50881)
0929 22:55:22.146244 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:22.146255 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:22.146316 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:22.146464 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:22.146464 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:22.146619 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:22.146665 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.146667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.147274 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.147274 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.147808 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.147810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.148111 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.148112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.148149 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.148652 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:22.148657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:22.150314 (+ 1657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":53,"threads_started":1}
W20260929 22:55:22.150517 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:22.146179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:50881 (local address 127.0.124.190:44283)
0929 22:55:22.146325 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:22.146327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:22.146336 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:22.146362 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:22.146362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:22.146372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:22.146429 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:22.146728 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.147215 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.147873 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.148056 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.148103 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.150397 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:50881: BlockingRecv error: recv got EOF from 127.0.124.129:50881 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:22.297560 9745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:22.292412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:53199)
0929 22:55:22.292568 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:22.292582 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:22.292693 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:22.292869 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:22.292870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:22.293114 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:22.293173 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.293176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.293938 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.293939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.294597 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.294599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.295065 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.295066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.295130 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.295706 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:22.295711 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:22.297491 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
W20260929 22:55:22.297678 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:22.292513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:53199 (local address 127.0.124.190:44283)
0929 22:55:22.292577 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:22.292580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:22.292669 (+ 89us) server_negotiation.cc:407] Connection header received
0929 22:55:22.292769 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:22.292769 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:22.292785 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:22.292861 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:22.293265 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.293842 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.294692 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.294973 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.295065 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.297584 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:53199: BlockingRecv error: recv got EOF from 127.0.124.130:53199 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:22 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:22.432480 9746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:22.427693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:34723)
0929 22:55:22.427862 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:22.427874 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:22.427955 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:22.428092 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:22.428092 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:22.428290 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:22.428335 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.428337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.428995 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.428996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.429525 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:22.429526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.429873 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.429874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:22.429932 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.430439 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:22.430445 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:22.432371 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
W20260929 22:55:22.432514 9744 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:22.427775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:34723 (local address 127.0.124.190:44283)
0929 22:55:22.427851 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:22.427853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:22.427942 (+ 89us) server_negotiation.cc:407] Connection header received
0929 22:55:22.428017 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:22.428018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:22.428032 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:22.428086 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:22.428418 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.428904 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.429608 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:22.429795 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:22.429873 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:22.432455 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:34723: BlockingRecv error: recv got EOF from 127.0.124.131:34723 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:23.155068 9747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:23.150794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:52341)
0929 22:55:23.150925 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:23.150936 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:23.150988 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:23.151108 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:23.151109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:23.151262 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:23.151310 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.151311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.151923 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.151923 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.152503 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.152505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.152807 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.152807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.152865 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.153294 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:23.153298 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:23.154981 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
W20260929 22:55:23.155148 9748 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:23.150870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:52341 (local address 127.0.124.190:44283)
0929 22:55:23.150990 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:23.150992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:23.151005 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:55:23.151027 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:23.151027 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:23.151037 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:23.151095 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:23.151369 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.151864 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.152571 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.152752 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.152802 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.155078 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:52341: BlockingRecv error: recv got EOF from 127.0.124.129:52341 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:23.306594 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:23.298059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:35557)
0929 22:55:23.298219 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:23.298228 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:23.298307 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:23.298516 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:23.298517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:23.298759 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:23.298804 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.298806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.299511 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.299513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.300118 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.300120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.300523 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.300524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.300578 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.304831 (+ 4253us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:23.304835 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:23.306502 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
W20260929 22:55:23.306653 9748 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:23.298117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:35557 (local address 127.0.124.190:44283)
0929 22:55:23.298185 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:23.298188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:23.298289 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:55:23.298364 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:23.298365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:23.298378 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:23.298505 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:23.298883 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.299381 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.300228 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.300440 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.300524 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.306591 (+ 6067us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:35557: BlockingRecv error: recv got EOF from 127.0.124.130:35557 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:23 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:23.438437 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:23.433047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:54007)
0929 22:55:23.433228 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:23.433244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:23.433352 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:23.433571 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:23.433572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:23.433767 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:23.433820 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.433822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.434700 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.434701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.435315 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:23.435316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.435742 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.435743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:23.435808 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.436354 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:23.436359 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:23.438348 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
W20260929 22:55:23.438668 9748 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:23.433141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:54007 (local address 127.0.124.190:44283)
0929 22:55:23.433233 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:23.433235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:23.433330 (+ 95us) server_negotiation.cc:407] Connection header received
0929 22:55:23.433444 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:23.433445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:23.433463 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:23.433549 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:23.433949 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.434568 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.435422 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:23.435642 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:23.435742 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:23.438502 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:54007: BlockingRecv error: recv got EOF from 127.0.124.131:54007 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:24.160171 9751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:24.155541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:40405)
0929 22:55:24.155651 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:24.155663 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:24.155733 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:24.155865 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:24.155866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:24.156021 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:24.156069 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.156070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.156767 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.156768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.157291 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.157293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.157619 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.157620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.157661 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.158177 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:24.158182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:24.160115 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
W20260929 22:55:24.160329 9752 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:24.155609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:40405 (local address 127.0.124.190:44283)
0929 22:55:24.155732 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:24.155733 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:24.155742 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:24.155780 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:24.155780 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:24.155791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:24.155846 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:24.156131 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.156700 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.157363 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.157557 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.157609 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.160238 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:40405: BlockingRecv error: recv got EOF from 127.0.124.129:40405 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:24.312148 9754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:24.307065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:47923)
0929 22:55:24.307184 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:24.307201 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:24.307270 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:24.307412 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:24.307412 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:24.307587 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:24.307631 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.307633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.308365 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.308367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.308965 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.308967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.309345 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.309346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.309409 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.309904 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:24.309908 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:24.312054 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
W20260929 22:55:24.312187 9752 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:24.307213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:47923 (local address 127.0.124.190:44283)
0929 22:55:24.307281 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:24.307283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:24.307294 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:55:24.307325 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:24.307326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:24.307344 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:24.307407 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:24.307713 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.308199 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.309065 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.309262 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.309344 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.312128 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:47923: BlockingRecv error: recv got EOF from 127.0.124.130:47923 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:24 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:24.443799 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:24.439067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:56379)
0929 22:55:24.439258 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:24.439270 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:24.439359 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:24.439544 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:24.439544 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:24.439719 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:24.439762 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.439764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.440479 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.440480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.441046 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:24.441048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.441476 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.441477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:24.441558 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.441993 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:24.441998 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:24.443743 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":98,"threads_started":1}
W20260929 22:55:24.443918 9752 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:24.439185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:56379 (local address 127.0.124.190:44283)
0929 22:55:24.439256 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:24.439258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:24.439341 (+ 83us) server_negotiation.cc:407] Connection header received
0929 22:55:24.439418 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:24.439419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:24.439469 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:24.439537 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:24.439841 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.440404 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.441170 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:24.441370 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:24.441466 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:24.443823 (+ 2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:56379: BlockingRecv error: recv got EOF from 127.0.124.131:56379 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:25.165045 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:25.160652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:45885)
0929 22:55:25.160813 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:25.160827 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:25.160902 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:25.161066 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:25.161067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:25.161220 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:25.161267 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.161268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.161929 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.161930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.162438 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.162440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.162753 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.162754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.162789 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.163212 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:25.163216 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:25.164983 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":66,"threads_started":1}
W20260929 22:55:25.165172 9757 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:25.160761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:45885 (local address 127.0.124.190:44283)
0929 22:55:25.160885 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:25.160887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:25.160895 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:25.160964 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:25.160964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:25.160974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:25.161024 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:25.161331 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.161868 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.162507 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.162695 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.162746 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.165069 (+ 2323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:45885: BlockingRecv error: recv got EOF from 127.0.124.129:45885 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:25.317389 9758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:25.312654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:46709)
0929 22:55:25.312784 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:25.312797 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:25.312866 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:25.313044 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:25.313045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:25.313233 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:25.313277 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.313279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.313978 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.313979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.314538 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.314540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.314910 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.314910 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.314973 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.315462 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:25.315467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:25.317295 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
W20260929 22:55:25.317446 9757 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:25.312756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:46709 (local address 127.0.124.190:44283)
0929 22:55:25.312801 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:25.312803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:25.312850 (+ 47us) server_negotiation.cc:407] Connection header received
0929 22:55:25.312951 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:25.312952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:25.312973 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:25.313039 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:25.313357 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.313894 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.314626 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.314820 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.314898 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.317374 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:46709: BlockingRecv error: recv got EOF from 127.0.124.130:46709 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:25 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:25.449087 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:25.444386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:59295)
0929 22:55:25.444507 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:25.444519 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:25.444575 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:25.444753 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:25.444754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:25.444945 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:25.445023 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.445025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.445760 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.445760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.446294 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:25.446296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.446676 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.446676 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:25.446715 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.447142 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:25.447147 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:25.449029 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
W20260929 22:55:25.449230 9757 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:25.444461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:59295 (local address 127.0.124.190:44283)
0929 22:55:25.444549 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:25.444551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:25.444566 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:55:25.444659 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:25.444660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:25.444676 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:25.444744 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:25.445093 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.445689 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.446419 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:25.446606 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:25.446671 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:25.449148 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:59295: BlockingRecv error: recv got EOF from 127.0.124.131:59295 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:26.169775 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:26.165461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:45177)
0929 22:55:26.165606 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:26.165617 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:26.165666 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:26.165796 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:26.165797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:26.165949 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:26.166002 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.166003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.166623 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.166623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.167153 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.167155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.167524 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.167525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.167571 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.168024 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:26.168028 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:26.169721 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
W20260929 22:55:26.169880 9761 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:26.165532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:45177 (local address 127.0.124.190:44283)
0929 22:55:26.165652 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:26.165654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:26.165664 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:26.165714 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:26.165714 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:26.165724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:26.165780 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:26.166064 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.166552 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.167234 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.167439 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.167508 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.169805 (+ 2297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:45177: BlockingRecv error: recv got EOF from 127.0.124.129:45177 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":77,"threads_started":1}
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:26.322631 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:26.317840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:33721)
0929 22:55:26.318026 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:26.318038 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:26.318113 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:26.318270 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:26.318271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:26.318462 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:26.318505 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.318507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.319173 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.319174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.319779 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.319781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.320180 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.320181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.320258 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.320788 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:26.320793 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:26.322537 (+ 1744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":82,"threads_started":1}
W20260929 22:55:26.322679 9761 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:26.317924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:33721 (local address 127.0.124.190:44283)
0929 22:55:26.318004 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:26.318006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:26.318103 (+ 97us) server_negotiation.cc:407] Connection header received
0929 22:55:26.318178 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:26.318179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:26.318193 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:26.318266 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:26.318583 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.319076 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.319864 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.320095 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.320180 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.322617 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:33721: BlockingRecv error: recv got EOF from 127.0.124.130:33721 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:26 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:26.454252 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:26.449547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:35895)
0929 22:55:26.449722 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:26.449733 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:26.449819 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:26.449962 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:26.449963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:26.450151 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:26.450196 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.450203 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.450870 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.450871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.451469 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:26.451471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.451842 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.451843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:26.451899 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.452387 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:26.452391 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:26.454159 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":103,"threads_started":1}
W20260929 22:55:26.454291 9761 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:26.449640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:35895 (local address 127.0.124.190:44283)
0929 22:55:26.449709 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:26.449712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:26.449803 (+ 91us) server_negotiation.cc:407] Connection header received
0929 22:55:26.449874 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:26.449875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:26.449895 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:26.449956 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:26.450283 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.450777 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.451573 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:26.451768 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:26.451844 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:26.454231 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:35895: BlockingRecv error: recv got EOF from 127.0.124.131:35895 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:27.174639 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:27.170276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:41943)
0929 22:55:27.170478 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:27.170489 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:27.170539 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:27.170669 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:27.170670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:27.170825 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:27.170873 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.170874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.171494 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.171495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.172056 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.172058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.172387 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.172388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.172425 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.172828 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:27.172832 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:27.174580 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":85,"threads_started":1}
W20260929 22:55:27.174749 9765 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:27.170397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41943 (local address 127.0.124.190:44283)
0929 22:55:27.170544 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:27.170546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:27.170554 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:27.170575 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:27.170576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:27.170586 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:27.170651 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:27.170939 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.171424 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.172127 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.172323 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.172371 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.174673 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:41943: BlockingRecv error: recv got EOF from 127.0.124.129:41943 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:27.327736 9767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:27.323123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:54241)
0929 22:55:27.323272 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:27.323282 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:27.323332 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:27.323475 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:27.323476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:27.323630 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:27.323674 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.323675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.324492 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.324493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.325015 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.325016 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.325337 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.325338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.325374 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.325854 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:27.325859 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:27.327679 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
W20260929 22:55:27.327915 9765 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:27.323186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:54241 (local address 127.0.124.190:44283)
0929 22:55:27.323312 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:27.323314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:27.323325 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:55:27.323396 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:27.323396 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:27.323407 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:27.323462 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:27.323745 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.324426 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.325091 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.325274 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.325332 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.327806 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:54241: BlockingRecv error: recv got EOF from 127.0.124.130:54241 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:27 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:27.459713 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:27.454863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:56519)
0929 22:55:27.455028 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:27.455041 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:27.455111 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:27.455260 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:27.455260 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:27.455507 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:27.455566 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.455568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.456409 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.456411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.456975 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:27.456976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.457306 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.457307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:27.457352 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.457896 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:27.457901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:27.459653 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
W20260929 22:55:27.459785 9765 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:27.454957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:56519 (local address 127.0.124.190:44283)
0929 22:55:27.455015 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:27.455018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:27.455092 (+ 74us) server_negotiation.cc:407] Connection header received
0929 22:55:27.455167 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:27.455168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:27.455181 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:27.455254 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:27.455645 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.456311 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.457059 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:27.457232 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:27.457280 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:27.459739 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:56519: BlockingRecv error: recv got EOF from 127.0.124.131:56519 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:28.180007 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:28.175122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:54669)
0929 22:55:28.175258 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:28.175268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:28.175314 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:28.175475 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:28.175476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:28.175632 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:28.175680 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.175682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.176601 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.176602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.177155 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.177156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.177485 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.177486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.177534 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.178035 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:28.178039 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:28.179901 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
W20260929 22:55:28.180061 9770 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:28.175201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:54669 (local address 127.0.124.190:44283)
0929 22:55:28.175346 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:28.175348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:28.175361 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:55:28.175383 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:28.175383 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:28.175394 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:28.175459 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:28.175747 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.176541 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.177220 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.177404 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.177453 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.179972 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:54669: BlockingRecv error: recv got EOF from 127.0.124.129:54669 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:28.336540 9771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:28.328272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:33055)
0929 22:55:28.328437 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:28.328448 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:28.328512 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:28.328717 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:28.328718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:28.328940 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:28.329000 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.329002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.329628 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.329629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.330152 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.330153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.330507 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.330507 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.330544 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.334556 (+ 4012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:28.334561 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:28.336471 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
W20260929 22:55:28.336655 9770 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:28.328326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:33055 (local address 127.0.124.190:44283)
0929 22:55:28.328381 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:28.328383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:28.328504 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:55:28.328570 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:28.328571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:28.328584 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:28.328668 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:28.329080 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.329565 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.330228 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.330405 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.330491 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.336576 (+ 6085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:33055: BlockingRecv error: recv got EOF from 127.0.124.130:33055 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:28 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:28.465027 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:28.460224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:34613)
0929 22:55:28.460344 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:28.460355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:28.460436 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:28.460577 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:28.460578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:28.460772 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:28.460819 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.460821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.461558 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.461559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.462132 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:28.462134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.462497 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.462498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:28.462562 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.462996 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:28.463001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:28.464960 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
W20260929 22:55:28.465101 9770 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:28.460369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:34613 (local address 127.0.124.190:44283)
0929 22:55:28.460433 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:28.460435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:28.460445 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:28.460492 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:28.460493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:28.460507 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:28.460565 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:28.460919 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.461461 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.462222 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:28.462425 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:28.462500 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:28.465051 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:34613: BlockingRecv error: recv got EOF from 127.0.124.131:34613 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:29.185245 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:29.180458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:48239)
0929 22:55:29.180590 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:29.180601 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:29.180654 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:29.180917 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:29.180918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:29.181070 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:29.181117 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.181119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.181834 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.181835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.182318 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.182319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.182664 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.182664 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.182701 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.183310 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:29.183315 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:29.185187 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
W20260929 22:55:29.185351 9774 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:29.180563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:48239 (local address 127.0.124.190:44283)
0929 22:55:29.180703 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:29.180705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:29.180713 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:29.180734 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:29.180734 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:29.180745 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:29.180810 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:29.181195 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.181766 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.182387 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.182603 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.182656 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.185270 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:48239: BlockingRecv error: recv got EOF from 127.0.124.129:48239 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:29.341398 9775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:29.336983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:42291)
0929 22:55:29.337105 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:29.337119 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:29.337177 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:29.337309 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:29.337309 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:29.337494 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:29.337539 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.337540 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.338206 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.338206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.338709 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.338710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.339035 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.339036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.339072 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.339549 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:29.339554 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:29.341334 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
W20260929 22:55:29.341572 9774 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:29.337060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:42291 (local address 127.0.124.190:44283)
0929 22:55:29.337140 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:29.337142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:29.337166 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:55:29.337235 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:29.337236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:29.337249 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:29.337289 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:29.337636 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.338138 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.338782 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.338971 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.339027 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.341456 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:42291: BlockingRecv error: recv got EOF from 127.0.124.130:42291 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:29 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:29.470158 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:29.465572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:58983)
0929 22:55:29.465709 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:29.465728 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:29.465805 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:29.465973 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:29.465974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:29.466152 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:29.466197 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.466199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.466843 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.466844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.467382 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:29.467383 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.467737 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.467738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:29.467801 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.468278 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:29.468282 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:29.470047 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":56,"threads_started":1}
W20260929 22:55:29.470199 9774 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:29.465749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:58983 (local address 127.0.124.190:44283)
0929 22:55:29.465817 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:29.465818 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:29.465847 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:55:29.465872 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:29.465873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:29.465893 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:29.465967 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:29.466282 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.466763 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.467465 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:29.467663 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:29.467740 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:29.470139 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:58983: BlockingRecv error: recv got EOF from 127.0.124.131:58983 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:30.190176 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:30.185715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:58161)
0929 22:55:30.185855 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:30.185865 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:30.185917 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:30.186049 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:30.186050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:30.186220 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:30.186265 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.186267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.186887 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.186888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.187403 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.187405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.187743 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.187743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.187780 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.188183 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:30.188187 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:30.190097 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
W20260929 22:55:30.190292 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:30.185794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:58161 (local address 127.0.124.190:44283)
0929 22:55:30.185905 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:30.185907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:30.185915 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:30.185973 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:30.185974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:30.185985 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:30.186034 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:30.186324 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.186825 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.187485 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.187681 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.187732 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.190191 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:58161: BlockingRecv error: recv got EOF from 127.0.124.129:58161 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":47,"threads_started":1}
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:30.346678 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:30.341890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:42937)
0929 22:55:30.342056 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:30.342066 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:30.342121 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:30.342240 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:30.342241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:30.342401 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:30.342446 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.342448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.343161 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.343161 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.343660 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.343661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.344008 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.344009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.344100 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.344690 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:30.344695 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:30.346611 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
W20260929 22:55:30.346896 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:30.341944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:42937 (local address 127.0.124.190:44283)
0929 22:55:30.342021 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:30.342023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:30.342121 (+ 98us) server_negotiation.cc:407] Connection header received
0929 22:55:30.342168 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:30.342168 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:30.342179 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:30.342228 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:30.342509 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.343092 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.343726 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.343941 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.343994 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.346824 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:42937: BlockingRecv error: recv got EOF from 127.0.124.130:42937 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:30 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:30.475006 9780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:30.470612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:60495)
0929 22:55:30.470743 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:30.470754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:30.470814 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:30.470921 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:30.470921 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:30.471081 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:30.471127 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.471128 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.471719 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.471720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.472304 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:30.472307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.472653 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.472653 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:30.472692 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.473163 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:30.473167 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:30.474939 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
W20260929 22:55:30.475116 9778 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:30.470694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:60495 (local address 127.0.124.190:44283)
0929 22:55:30.470738 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:30.470740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:30.470801 (+ 61us) server_negotiation.cc:407] Connection header received
0929 22:55:30.470864 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:30.470864 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:30.470875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:30.470909 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:30.471184 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.471655 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.472403 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:30.472599 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:30.472647 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:30.475044 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:60495: BlockingRecv error: recv got EOF from 127.0.124.131:60495 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:31.195353 9782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:31.190637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:48215)
0929 22:55:31.190779 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:31.190789 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:31.190837 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:31.190980 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:31.190981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:31.191139 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:31.191187 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.191189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.191809 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.191810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.192669 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.192672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.193071 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.193071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.193111 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.193504 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:31.193508 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:31.195246 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260929 22:55:31.195393 9783 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:31.190727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:48215 (local address 127.0.124.190:44283)
0929 22:55:31.190860 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:31.190861 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:31.190869 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:31.190890 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:31.190890 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:31.190900 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:31.190965 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:31.191253 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.191744 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.192729 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.193010 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.193065 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.195320 (+ 2255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:48215: BlockingRecv error: recv got EOF from 127.0.124.129:48215 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:31.351785 9784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:31.347172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:55679)
0929 22:55:31.347399 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:31.347414 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:31.347480 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:31.347632 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:31.347633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:31.347791 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:31.347836 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.347837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.348567 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.348568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.349104 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.349106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.349441 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.349442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.349483 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.349912 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:31.349916 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:31.351677 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":171,"threads_started":1}
W20260929 22:55:31.351820 9783 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:31.347244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:55679 (local address 127.0.124.190:44283)
0929 22:55:31.347301 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:31.347303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:31.347522 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:55:31.347551 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:31.347552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:31.347564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:31.347611 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:31.347923 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.348452 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.349184 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.349367 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.349434 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.351755 (+ 2321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:55679: BlockingRecv error: recv got EOF from 127.0.124.130:55679 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:31 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:31.480099 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:31.475470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:35771)
0929 22:55:31.475652 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:31.475672 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:31.475745 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:31.475885 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:31.475886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:31.476063 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:31.476113 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.476115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.476750 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.476751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.477295 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:31.477297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.477613 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.477613 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:31.477667 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.478222 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:31.478226 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:31.480005 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":83,"threads_started":1}
W20260929 22:55:31.480151 9783 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:31.475595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:35771 (local address 127.0.124.190:44283)
0929 22:55:31.475675 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:31.475676 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:31.475726 (+ 50us) server_negotiation.cc:407] Connection header received
0929 22:55:31.475792 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:31.475793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:31.475804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:31.475853 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:31.476178 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.476681 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.477370 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:31.477546 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:31.477595 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:31.480089 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:35771: BlockingRecv error: recv got EOF from 127.0.124.131:35771 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:32.200553 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:32.195844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:39305)
0929 22:55:32.196026 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:32.196037 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:32.196095 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:32.196298 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:32.196299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:32.196571 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:32.196627 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.196629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.197242 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.197243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.197789 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.197791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.198109 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.198109 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.198157 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.198654 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:32.198658 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:32.200451 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":110,"threads_started":1}
W20260929 22:55:32.200590 9787 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:32.195935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:39305 (local address 127.0.124.190:44283)
0929 22:55:32.196090 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:32.196092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:32.196102 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:32.196171 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:32.196172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:32.196185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:32.196291 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:32.196693 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.197173 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.197850 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.198042 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.198094 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.200527 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:39305: BlockingRecv error: recv got EOF from 127.0.124.129:39305 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:32.357043 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:32.352329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:44465)
0929 22:55:32.352461 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:32.352471 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:32.352559 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:32.352733 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:32.352734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:32.352909 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:32.352952 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.352953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.353668 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.353669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.354195 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.354196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.354574 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.354575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.354637 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.355133 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:32.355137 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:32.356935 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
W20260929 22:55:32.357087 9787 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:32.352472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:44465 (local address 127.0.124.190:44283)
0929 22:55:32.352553 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:32.352556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:32.352565 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:32.352629 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:32.352630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:32.352642 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:32.352715 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:32.353056 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.353574 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.354281 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.354487 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.354572 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.357025 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:44465: BlockingRecv error: recv got EOF from 127.0.124.130:44465 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:32 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:32.485351 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:32.480669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:50443)
0929 22:55:32.480844 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:32.480856 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:32.480950 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:32.481116 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:32.481117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:32.481307 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:32.481352 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.481354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.482035 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.482036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.482582 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:32.482583 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.482933 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.482934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:32.482984 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.483405 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:32.483409 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:32.485232 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":87,"threads_started":1}
W20260929 22:55:32.485477 9787 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:32.480765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:50443 (local address 127.0.124.190:44283)
0929 22:55:32.480848 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:32.480850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:32.480933 (+ 83us) server_negotiation.cc:407] Connection header received
0929 22:55:32.481024 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:32.481025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:32.481038 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:32.481109 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:32.481435 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.481953 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.482664 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:32.482851 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:32.482934 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:32.485346 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:50443: BlockingRecv error: recv got EOF from 127.0.124.131:50443 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:33.205633 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:33.201039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:50507)
0929 22:55:33.201189 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:33.201201 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:33.201267 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:33.201415 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:33.201416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:33.201581 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:33.201628 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.201629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.202265 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.202266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.202771 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.202773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.203096 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.203097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.203134 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.203643 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:33.203648 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:33.205537 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
W20260929 22:55:33.205693 9791 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:33.201102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:50507 (local address 127.0.124.190:44283)
0929 22:55:33.201246 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:33.201248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:33.201258 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:55:33.201323 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:33.201324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:33.201334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:33.201394 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:33.201695 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.202198 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.202840 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.203035 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.203086 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.205624 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:50507: BlockingRecv error: recv got EOF from 127.0.124.129:50507 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:33.367539 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:33.357495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:40439)
0929 22:55:33.357636 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:33.357646 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:33.357700 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:33.357849 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:33.357850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:33.358025 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:33.358070 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.358071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.358674 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.358674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.359219 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.359220 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.359573 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.359574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.359638 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.365678 (+ 6040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:33.365684 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:33.367475 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":69,"threads_started":1}
W20260929 22:55:33.367623 9791 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:33.357564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:40439 (local address 127.0.124.190:44283)
0929 22:55:33.357659 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:33.357660 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:33.357691 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:55:33.357771 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:33.357772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:33.357782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:33.357834 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:33.358134 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.358611 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.359296 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.359488 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.359544 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.367575 (+ 8031us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:40439: BlockingRecv error: recv got EOF from 127.0.124.130:40439 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:33 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.131@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:33.490778 9793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:33.485766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.131:35225)
0929 22:55:33.485887 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:33.485897 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:33.485962 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:33.486137 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:33.486138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:33.486296 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:33.486341 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.486342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.486986 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.486987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.487545 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:33.487546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.487868 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.487869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:33.487907 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.488432 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:33.488440 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:33.490720 (+ 2280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
W20260929 22:55:33.490944 9791 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:33.485844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:35225 (local address 127.0.124.190:44283)
0929 22:55:33.485903 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:33.485904 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:33.485964 (+ 60us) server_negotiation.cc:407] Connection header received
0929 22:55:33.486038 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:33.486039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:33.486053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:33.486120 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:33.486409 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.486913 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.487623 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:33.487804 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:33.487858 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:33.490876 (+ 3018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.131:35225: BlockingRecv error: recv got EOF from 127.0.124.131:35225 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Sep 29 22:55:34 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:34 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.129@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:34.210952 9794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.206232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.129:52953)
0929 22:55:34.206380 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:34.206393 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:34.206471 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:34.206660 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:34.206662 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:34.206840 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:34.206899 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.206900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.207549 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.207550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.208166 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.208168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.208615 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.208616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.208666 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.209114 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:34.209118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:34.210876 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
W20260929 22:55:34.211047 9796 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:34.206285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:52953 (local address 127.0.124.190:44283)
0929 22:55:34.206404 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:34.206406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:34.206453 (+ 47us) server_negotiation.cc:407] Connection header received
0929 22:55:34.206522 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:34.206522 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:34.206532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:34.206591 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:34.206972 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.207457 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.208303 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.208525 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.208581 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.210975 (+ 2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.129:52953: BlockingRecv error: recv got EOF from 127.0.124.129:52953 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
Sep 29 22:55:34 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:55:34 dist-test-slave-512q krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.124.130@KRBTEST.COM for oryx/127.0.124.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:55:34.372516 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.368082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44283 (local address 127.0.124.130:45837)
0929 22:55:34.368246 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:34.368256 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:34.368311 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:34.368441 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:34.368442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:34.368603 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:34.368649 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.368651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.369273 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.369273 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.369814 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.369816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.370175 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.370176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.370215 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.370714 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:34.370726 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:34.372449 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.124.190:44283: Server oryx/127.0.124.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":80,"threads_started":1}
W20260929 22:55:34.372640 9796 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:34.368134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:45837 (local address 127.0.124.190:44283)
0929 22:55:34.368187 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:34.368189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:34.368298 (+ 109us) server_negotiation.cc:407] Connection header received
0929 22:55:34.368369 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:34.368369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:34.368380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:34.368421 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:34.368718 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.369209 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.369894 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.370096 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.370166 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.372540 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.124.130:45837: BlockingRecv error: recv got EOF from 127.0.124.130:45837 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:55:34.410058 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9309
I20260929 22:55:34.414505 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9463
I20260929 22:55:34.418532 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9597
I20260929 22:55:34.422448 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9237
2026-09-29T22:55:34Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17433 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-29T22:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:34Z Disabled control of system clock
I20260929 22:55:34.449455 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44145
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:37855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:44145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 22:55:34.527812 9801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:34.528010 9801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:34.528029 9801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:34.529212 9801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:34.529253 9801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:34.529265 9801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:34.529277 9801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:34.529338 9801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:34.530629 9801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:44145
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:34.530867 9801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:34.531152 9801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:34.536147 9807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.536154 9810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:34.536311 9801 server_base.cc:1034] running on GCE node
W20260929 22:55:34.536158 9806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:34.536630 9801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:34.536864 9801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:34.538012 9801 hybrid_clock.cc:648] HybridClock initialized: now 1790722534537998 us; error 27 us; skew 500 ppm
I20260929 22:55:34.539296 9801 webserver.cc:460] Webserver started at http://127.0.124.190:44471/ using document root <none> and password file <none>
I20260929 22:55:34.539528 9801 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:34.539577 9801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:34.539752 9801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:34.540827 9801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "71c83211593a44f9abd1f5965f4d82e7"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "4d231589c621009de5dd3f43e9cb4e2a"
server_key_iv: "09b92ac3b5790dab6031e471b19e9078"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.541172 9801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "71c83211593a44f9abd1f5965f4d82e7"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "4d231589c621009de5dd3f43e9cb4e2a"
server_key_iv: "09b92ac3b5790dab6031e471b19e9078"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.542441 9801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:55:34.543146 9816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.543341 9801 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:34.543435 9801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "71c83211593a44f9abd1f5965f4d82e7"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "4d231589c621009de5dd3f43e9cb4e2a"
server_key_iv: "09b92ac3b5790dab6031e471b19e9078"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.543519 9801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:34.554212 9801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:34.554476 9801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:34.554621 9801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:34.558271 9801 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:44145
I20260929 22:55:34.558300 9871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:44145 every 8 connection(s)
I20260929 22:55:34.558595 9801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:34.559166 9872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:34.561659 9872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: Bootstrap starting.
I20260929 22:55:34.562180 9872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:34.562392 9872 log.cc:824] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:34.562970 9872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: No bootstrap required, opened a new log
I20260929 22:55:34.563338 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9801
I20260929 22:55:34.563431 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:34.563614 498 external_mini_cluster.cc:1428] Setting key 67093fa3ec0b2ab7cff71569c3e16400
I20260929 22:55:34.565044 9872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } }
I20260929 22:55:34.565208 9872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:34.565300 9872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c83211593a44f9abd1f5965f4d82e7, State: Initialized, Role: FOLLOWER
I20260929 22:55:34.565429 9872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } }
I20260929 22:55:34.565515 9872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:34.565546 9872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:34.565596 9872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:34.566283 9872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } }
I20260929 22:55:34.566387 9872 leader_election.cc:302] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71c83211593a44f9abd1f5965f4d82e7; no voters:
I20260929 22:55:34.566525 9872 leader_election.cc:288] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:34.566561 9877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:34.566722 9877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [term 1 LEADER]: Becoming Leader. State: Replica: 71c83211593a44f9abd1f5965f4d82e7, State: Running, Role: LEADER
I20260929 22:55:34.566742 9872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:34.566843 9877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } }
I20260929 22:55:34.567241 9878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71c83211593a44f9abd1f5965f4d82e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } } }
I20260929 22:55:34.567255 9879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71c83211593a44f9abd1f5965f4d82e7. Latest consensus state: current_term: 1 leader_uuid: "71c83211593a44f9abd1f5965f4d82e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c83211593a44f9abd1f5965f4d82e7" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44145 } } }
I20260929 22:55:34.567332 9878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:34.567366 9879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7 [sys.catalog]: This master's current role is: LEADER
W20260929 22:55:34.568718 9893 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:55:34.568827 9893 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:55:34.568917 9883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:34.569101 9883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:34.570339 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.564101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40804 (local address 127.0.124.190:44145)
0929 22:55:34.564318 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:34.564327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:34.564359 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:55:34.565008 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:34.565016 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:34.565098 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:34.565243 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:34.565502 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.567206 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.568409 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.568839 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.568978 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.569666 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:34.569670 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:34.569670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:34.569839 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:34.569871 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:34.569881 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:34.569988 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:34.570053 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 22:55:34.570147 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260929 22:55:34.570914 9883 catalog_manager.cc:1347] Generated new cluster ID: 9c1978c949094b59b1b4836ec3b2fe3f
I20260929 22:55:34.570968 9883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:34.577710 9883 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:34.578193 9883 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:34.580466 9883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71c83211593a44f9abd1f5965f4d82e7: Generated new TSK 0
I20260929 22:55:34.580623 9883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:34.584350 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--builtin_ntp_servers=127.0.124.148:37855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 22:55:34.677508 9896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:34.677697 9896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:34.677717 9896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:34.678812 9896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:34.678849 9896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:34.678874 9896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:34.680388 9896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:34.680630 9896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:34.680936 9896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:34.686702 9901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.686684 9902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.686712 9904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:34.686982 9896 server_base.cc:1034] running on GCE node
I20260929 22:55:34.687218 9896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:34.687453 9896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:34.688622 9896 hybrid_clock.cc:648] HybridClock initialized: now 1790722534688608 us; error 31 us; skew 500 ppm
I20260929 22:55:34.689913 9896 webserver.cc:460] Webserver started at http://127.0.124.129:41633/ using document root <none> and password file <none>
I20260929 22:55:34.690177 9896 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:34.690254 9896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:34.690407 9896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:34.691474 9896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "291af4540e974a80870b59df602e2b75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "f0c822351e17eb5487d0ab8a5ff1d847"
server_key_iv: "f8d8fa963790fb28833bef5bc3882830"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.691831 9896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "291af4540e974a80870b59df602e2b75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "f0c822351e17eb5487d0ab8a5ff1d847"
server_key_iv: "f8d8fa963790fb28833bef5bc3882830"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.693259 9896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:34.694062 9910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.694233 9896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:55:34.694334 9896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "291af4540e974a80870b59df602e2b75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "f0c822351e17eb5487d0ab8a5ff1d847"
server_key_iv: "f8d8fa963790fb28833bef5bc3882830"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.694414 9896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:34.726019 9896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:34.726351 9896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:34.726522 9896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:34.726771 9896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:34.727104 9896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:34.727159 9896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.727195 9896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:34.727221 9896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.732749 9896 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:43277
I20260929 22:55:34.732827 10023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:43277 every 8 connection(s)
I20260929 22:55:34.733155 9896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:34.738209 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.733984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:38279 (local address 127.0.124.190:44145)
0929 22:55:34.734072 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:34.734075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:34.734283 (+ 208us) server_negotiation.cc:407] Connection header received
0929 22:55:34.734833 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:34.734834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:34.734846 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:34.734906 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:34.735559 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.736050 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.737001 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.737183 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.737236 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.737975 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:34.737976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:34.737976 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:34.737980 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:34.737994 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:34.737998 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:34.738041 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:34.738123 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 22:55:34.738148 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:55:34.738391 10026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.733961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44145 (local address 127.0.124.129:38279)
0929 22:55:34.734162 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:34.734197 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:34.734714 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:34.734979 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:34.734983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:34.734992 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:34.735469 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.735473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.736127 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.736128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.736930 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.736932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.737255 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.737256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.737363 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.737847 (+ 484us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:34.737847 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:34.737875 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:34.737897 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:34.738054 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:34.738058 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:34.738060 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:34.738114 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:55:34.738191 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":106,"threads_started":1}
I20260929 22:55:34.738874 10024 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44145
I20260929 22:55:34.738969 10024 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:34.739105 10024 heartbeater.cc:511] Master 127.0.124.190:44145 requested a full tablet report, sending...
I20260929 22:55:34.739769 9834 ts_manager.cc:194] Registered new tserver with Master: 291af4540e974a80870b59df602e2b75 (127.0.124.129:43277)
I20260929 22:55:34.740077 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 9896
I20260929 22:55:34.740180 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:34.740437 498 external_mini_cluster.cc:1428] Setting key dae2081f343dc17eadfa81a075dbf26d
I20260929 22:55:34.740624 9834 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.129:38279
I20260929 22:55:34.741614 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--builtin_ntp_servers=127.0.124.148:37855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 22:55:34.823721 10027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:34.823927 10027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:34.823948 10027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:34.825117 10027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:34.825156 10027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:34.825205 10027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:34.826510 10027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:34.826758 10027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:34.827044 10027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:34.831905 10035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.831944 10032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.831918 10033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:34.832175 10027 server_base.cc:1034] running on GCE node
I20260929 22:55:34.832422 10027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:34.832647 10027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:34.833820 10027 hybrid_clock.cc:648] HybridClock initialized: now 1790722534833801 us; error 38 us; skew 500 ppm
I20260929 22:55:34.835047 10027 webserver.cc:460] Webserver started at http://127.0.124.130:43553/ using document root <none> and password file <none>
I20260929 22:55:34.835330 10027 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:34.835395 10027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:34.835530 10027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:34.836637 10027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "0e9fad62ec5247da82f09d2c807abd75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "30303fd41cead600438de684af5de41e"
server_key_iv: "74b0fe51440d94db94d9709dc919a65e"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.836978 10027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "0e9fad62ec5247da82f09d2c807abd75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "30303fd41cead600438de684af5de41e"
server_key_iv: "74b0fe51440d94db94d9709dc919a65e"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.838205 10027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:55:34.838919 10041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.839105 10027 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:34.839200 10027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "0e9fad62ec5247da82f09d2c807abd75"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "30303fd41cead600438de684af5de41e"
server_key_iv: "74b0fe51440d94db94d9709dc919a65e"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.839284 10027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:34.873924 10027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:34.874251 10027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:34.874413 10027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:34.874636 10027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:34.874954 10027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:34.875012 10027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.875072 10027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:34.875100 10027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.881266 10027 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:35965
I20260929 22:55:34.881296 10155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:35965 every 8 connection(s)
I20260929 22:55:34.881662 10027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:34.886565 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10027
I20260929 22:55:34.886668 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:34.886878 498 external_mini_cluster.cc:1428] Setting key 1a1a15fe36c0fc2a69a7ccae8577ce34
I20260929 22:55:34.886873 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.882486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:46873 (local address 127.0.124.190:44145)
0929 22:55:34.882540 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:34.882543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:34.882792 (+ 249us) server_negotiation.cc:407] Connection header received
0929 22:55:34.883268 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:34.883269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:34.883285 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:34.883356 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:34.883968 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.884564 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.885514 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.885705 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.885771 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.886546 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:34.886548 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:34.886548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:34.886553 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:34.886569 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:34.886573 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:34.886651 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:34.886741 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 22:55:34.886773 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:55:34.887075 10158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:34.882480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44145 (local address 127.0.124.130:46873)
0929 22:55:34.882673 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:34.882707 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:34.883182 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:34.883406 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:34.883410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:34.883417 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:34.883890 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.883893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.884655 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.884656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.885428 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:34.885430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:34.885783 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:34.885784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:34.885886 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:34.886407 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:34.886407 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:34.886434 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:34.886455 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:34.886654 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:34.886659 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:34.886662 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:34.886734 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:55:34.886836 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260929 22:55:34.887694 10156 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44145
I20260929 22:55:34.887780 10156 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:34.887799 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--builtin_ntp_servers=127.0.124.148:37855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260929 22:55:34.887969 10156 heartbeater.cc:511] Master 127.0.124.190:44145 requested a full tablet report, sending...
I20260929 22:55:34.888388 9833 ts_manager.cc:194] Registered new tserver with Master: 0e9fad62ec5247da82f09d2c807abd75 (127.0.124.130:35965)
I20260929 22:55:34.888752 9833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.130:46873
W20260929 22:55:34.971254 10159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:34.971531 10159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:34.971555 10159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:34.972795 10159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:34.972836 10159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:34.972860 10159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:34.974254 10159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:34.974511 10159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:34.974803 10159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:34.979549 10164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.979641 10167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:34.979645 10165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:34.979789 10159 server_base.cc:1034] running on GCE node
I20260929 22:55:34.980049 10159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:34.980315 10159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:34.981495 10159 hybrid_clock.cc:648] HybridClock initialized: now 1790722534981475 us; error 35 us; skew 500 ppm
I20260929 22:55:34.982786 10159 webserver.cc:460] Webserver started at http://127.0.124.131:34379/ using document root <none> and password file <none>
I20260929 22:55:34.983037 10159 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:34.983080 10159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:34.983219 10159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:34.984411 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "a5327fe1974740ddbf21cf18e3bf733b"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "2aec1dd473f4ec616032284b1a7c8315"
server_key_iv: "29b3bf196ebe290d4c39218631f84cad"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.984763 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "a5327fe1974740ddbf21cf18e3bf733b"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "2aec1dd473f4ec616032284b1a7c8315"
server_key_iv: "29b3bf196ebe290d4c39218631f84cad"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.986018 10159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:55:34.986685 10173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:34.986860 10159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:34.986948 10159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "a5327fe1974740ddbf21cf18e3bf733b"
format_stamp: "Formatted at 2026-09-29 22:55:34 on dist-test-slave-512q"
server_key: "2aec1dd473f4ec616032284b1a7c8315"
server_key_iv: "29b3bf196ebe290d4c39218631f84cad"
server_key_version: "encryptionkey@0"
I20260929 22:55:34.987017 10159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:35.015312 10159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:35.015645 10159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:35.015799 10159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:35.016029 10159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:35.016438 10159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:35.016472 10159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.016495 10159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:35.016538 10159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.022119 10159 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:44297
I20260929 22:55:35.022166 10286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:44297 every 8 connection(s)
I20260929 22:55:35.022492 10159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:35.023032 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10159
I20260929 22:55:35.023141 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:35.023347 498 external_mini_cluster.cc:1428] Setting key 00c637fe59dec64b4a1802613056a93f
I20260929 22:55:35.027734 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.023191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:48171 (local address 127.0.124.190:44145)
0929 22:55:35.023246 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.023249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.023522 (+ 273us) server_negotiation.cc:407] Connection header received
0929 22:55:35.024138 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.024139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.024165 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.024247 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.024940 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:35.025422 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:35.026514 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:35.026697 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:35.026750 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:35.027533 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:35.027534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:35.027534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:35.027538 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:35.027553 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:35.027556 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:35.027597 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:35.027653 (+ 56us) server_negotiation.cc:299] Negotiation successful
0929 22:55:35.027678 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:55:35.027947 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.023194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:44145 (local address 127.0.124.131:48171)
0929 22:55:35.023377 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:35.023416 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:35.024038 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:35.024327 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:35.024331 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:35.024341 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:35.024854 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:35.024858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:35.025564 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:35.025565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:35.026370 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:35.026372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:35.026775 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:35.026775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:35.026891 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:35.027364 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:35.027365 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:35.027434 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:35.027456 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:35.027598 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:35.027600 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:35.027602 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:35.027655 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:55:35.027727 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260929 22:55:35.028381 10287 heartbeater.cc:347] Connected to a master server at 127.0.124.190:44145
I20260929 22:55:35.028478 10287 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:35.028618 10287 heartbeater.cc:511] Master 127.0.124.190:44145 requested a full tablet report, sending...
I20260929 22:55:35.028960 9833 ts_manager.cc:194] Registered new tserver with Master: a5327fe1974740ddbf21cf18e3bf733b (127.0.124.131:44297)
I20260929 22:55:35.029286 9833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.131:48171
I20260929 22:55:35.035151 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:55:35.036957 9876 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:35.036531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40806 (local address 127.0.124.190:44145)
0929 22:55:35.036588 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.036589 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.036705 (+ 116us) server_negotiation.cc:407] Connection header received
0929 22:55:35.036741 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.036742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.036752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.036804 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.036908 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40806: BlockingRecv error: recv got EOF from 127.0.0.1:40806 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:55:35.037029 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9896
I20260929 22:55:35.041471 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10027
I20260929 22:55:35.045868 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10159
I20260929 22:55:35.050319 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 9801
2026-09-29T22:55:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (627 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-29T22:55:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:35Z Disabled control of system clock
I20260929 22:55:35.076699 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36153
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:55:35.159984 10298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:35.160298 10298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:35.160344 10298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:35.161628 10298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:35.161700 10298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:35.161724 10298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:35.161747 10298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:35.161778 10298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:35.163179 10298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:35.163470 10298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:35.163772 10298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:35.168735 10306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:35.168826 10303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.168864 10298 server_base.cc:1034] running on GCE node
W20260929 22:55:35.168804 10304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.169284 10298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:35.169615 10298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:35.170778 10298 hybrid_clock.cc:648] HybridClock initialized: now 1790722535170765 us; error 28 us; skew 500 ppm
I20260929 22:55:35.172086 10298 webserver.cc:460] Webserver started at http://127.0.124.190:39901/ using document root <none> and password file <none>
I20260929 22:55:35.172377 10298 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:35.172427 10298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:35.172550 10298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:35.173629 10298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "221f499afcb048a6be5547966531c671"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "11ca77f146101e2e5a6c64868bb3508b"
server_key_iv: "61e22373026a8420144992e0a56e6d65"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.174167 10298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "221f499afcb048a6be5547966531c671"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "11ca77f146101e2e5a6c64868bb3508b"
server_key_iv: "61e22373026a8420144992e0a56e6d65"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.175597 10298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:35.176366 10312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.176594 10298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:35.176681 10298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "221f499afcb048a6be5547966531c671"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "11ca77f146101e2e5a6c64868bb3508b"
server_key_iv: "61e22373026a8420144992e0a56e6d65"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.176749 10298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:35.180014 10298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:35.180331 10298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:35.180469 10298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:35.184090 10298 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:36153
I20260929 22:55:35.184118 10364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:36153 every 8 connection(s)
I20260929 22:55:35.184458 10298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:35.185082 10365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:35.187752 10365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671: Bootstrap starting.
I20260929 22:55:35.188361 10365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:35.188673 10365 log.cc:824] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:35.189424 10365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671: No bootstrap required, opened a new log
I20260929 22:55:35.190738 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10298
I20260929 22:55:35.190816 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:35.191008 498 external_mini_cluster.cc:1428] Setting key 3be05ddb6c3a340470464eaca1997aa1
I20260929 22:55:35.191263 10365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } }
I20260929 22:55:35.191475 10365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:35.191541 10365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221f499afcb048a6be5547966531c671, State: Initialized, Role: FOLLOWER
I20260929 22:55:35.191680 10365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } }
I20260929 22:55:35.191776 10365 raft_consensus.cc:388] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:35.191809 10365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:35.191857 10365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:35.192548 10365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } }
I20260929 22:55:35.192696 10365 leader_election.cc:302] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 221f499afcb048a6be5547966531c671; no voters:
I20260929 22:55:35.192860 10365 leader_election.cc:288] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:35.192895 10370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:35.192996 10370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [term 1 LEADER]: Becoming Leader. State: Replica: 221f499afcb048a6be5547966531c671, State: Running, Role: LEADER
I20260929 22:55:35.193073 10370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } }
I20260929 22:55:35.193114 10365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:35.193430 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.191528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.0.124.190:36153)
0929 22:55:35.191802 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.191812 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.191845 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:55:35.191957 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.191967 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.192013 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.192120 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.192831 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:35.192835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:35.192836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:35.192844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:35.192881 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:35.192897 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:35.193131 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:35.193166 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 22:55:35.193221 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":102,"threads_started":1}
I20260929 22:55:35.193439 10372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 221f499afcb048a6be5547966531c671. Latest consensus state: current_term: 1 leader_uuid: "221f499afcb048a6be5547966531c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } } }
I20260929 22:55:35.193485 10371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "221f499afcb048a6be5547966531c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f499afcb048a6be5547966531c671" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36153 } } }
I20260929 22:55:35.193583 10372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:35.193632 10371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:35.193784 10374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:35.194304 10374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:35.195950 10374 catalog_manager.cc:1347] Generated new cluster ID: 2f12b9df36724b6db8e2f00f666f6af6
I20260929 22:55:35.196002 10374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:35.207289 10374 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:35.207515 10374 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:35.212064 10374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 221f499afcb048a6be5547966531c671: Generated new TSK 0
I20260929 22:55:35.212278 10374 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:55:35.214424 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--builtin_ntp_servers=127.0.124.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:55:35.310211 10389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:35.310427 10389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:35.310462 10389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:35.311602 10389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:35.311661 10389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:35.311703 10389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:35.313088 10389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:35.313354 10389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:35.313647 10389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:35.319519 10394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:35.319540 10395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.319701 10389 server_base.cc:1034] running on GCE node
W20260929 22:55:35.319778 10397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.319970 10389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:35.320243 10389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:35.321396 10389 hybrid_clock.cc:648] HybridClock initialized: now 1790722535321384 us; error 30 us; skew 500 ppm
I20260929 22:55:35.322705 10389 webserver.cc:460] Webserver started at http://127.0.124.129:39611/ using document root <none> and password file <none>
I20260929 22:55:35.322945 10389 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:35.323012 10389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:35.323165 10389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:35.324247 10389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "d795e346cf094d38996688d046abe0d3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "6679151b25ab44c8bfd0c508457525f8"
server_key_iv: "ef87bd64504ac56180605519bdd68e8b"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.324627 10389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "d795e346cf094d38996688d046abe0d3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "6679151b25ab44c8bfd0c508457525f8"
server_key_iv: "ef87bd64504ac56180605519bdd68e8b"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.325942 10389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:35.326671 10403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.326821 10389 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:35.326920 10389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "d795e346cf094d38996688d046abe0d3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "6679151b25ab44c8bfd0c508457525f8"
server_key_iv: "ef87bd64504ac56180605519bdd68e8b"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.326987 10389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:35.330416 10389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:35.330684 10389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:35.330821 10389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:35.331032 10389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:35.331382 10389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:35.331416 10389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.331435 10389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:35.331470 10389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.338505 10389 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:36249
I20260929 22:55:35.338536 10517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:36249 every 8 connection(s)
I20260929 22:55:35.338863 10389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:35.339807 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10389
I20260929 22:55:35.339906 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:35.340133 498 external_mini_cluster.cc:1428] Setting key 4c533f310f816ee295faef226f5f0fd2
I20260929 22:55:35.341176 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--builtin_ntp_servers=127.0.124.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260929 22:55:35.342409 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.339576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:42505 (local address 127.0.124.190:36153)
0929 22:55:35.339644 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.339646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.339990 (+ 344us) server_negotiation.cc:407] Connection header received
0929 22:55:35.340731 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.340732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.340737 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.340828 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.342148 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:35.342149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:35.342150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:35.342154 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:35.342171 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:35.342176 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:35.342243 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:35.342299 (+ 56us) server_negotiation.cc:299] Negotiation successful
0929 22:55:35.342317 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:55:35.342549 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.339571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36153 (local address 127.0.124.129:42505)
0929 22:55:35.339839 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:35.339889 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:35.340636 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:35.340944 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:35.340948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:35.340959 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:35.341999 (+ 1040us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:35.342000 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:35.342028 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:35.342056 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:35.342244 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:35.342247 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:35.342249 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:35.342302 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:55:35.342348 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":87,"threads_started":1}
I20260929 22:55:35.343039 10518 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36153
I20260929 22:55:35.343138 10518 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:35.343278 10518 heartbeater.cc:511] Master 127.0.124.190:36153 requested a full tablet report, sending...
I20260929 22:55:35.343832 10329 ts_manager.cc:194] Registered new tserver with Master: d795e346cf094d38996688d046abe0d3 (127.0.124.129:36249)
W20260929 22:55:35.421819 10521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:35.422051 10521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:35.422109 10521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:35.423314 10521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:35.423378 10521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:35.423422 10521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:35.424813 10521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:35.425052 10521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:35.425350 10521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:35.430670 10529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:35.430686 10526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:35.430665 10527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.431203 10521 server_base.cc:1034] running on GCE node
I20260929 22:55:35.431396 10521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:35.431654 10521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:35.432786 10521 hybrid_clock.cc:648] HybridClock initialized: now 1790722535432773 us; error 36 us; skew 500 ppm
I20260929 22:55:35.433882 10521 webserver.cc:460] Webserver started at http://127.0.124.130:40751/ using document root <none> and password file <none>
I20260929 22:55:35.434137 10521 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:35.434216 10521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:35.434355 10521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:35.435372 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "439ceef3249a4408b8baf99fd82d74b3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "bf2c1f181bf4b1366eb5a84721587a3a"
server_key_iv: "112fbb26898daa2b409008444b23c4c3"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.435717 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "439ceef3249a4408b8baf99fd82d74b3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "bf2c1f181bf4b1366eb5a84721587a3a"
server_key_iv: "112fbb26898daa2b409008444b23c4c3"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.437076 10521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:35.437734 10535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.437886 10521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:35.437975 10521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "439ceef3249a4408b8baf99fd82d74b3"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "bf2c1f181bf4b1366eb5a84721587a3a"
server_key_iv: "112fbb26898daa2b409008444b23c4c3"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.438048 10521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:35.441308 10521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:35.441551 10521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:35.441689 10521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:35.441895 10521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:35.442209 10521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:35.442258 10521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.442296 10521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:35.442323 10521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.447777 10521 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:33745
I20260929 22:55:35.447817 10648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:33745 every 8 connection(s)
I20260929 22:55:35.448110 10521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:35.450899 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.448760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:47373 (local address 127.0.124.190:36153)
0929 22:55:35.448802 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.448804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.449027 (+ 223us) server_negotiation.cc:407] Connection header received
0929 22:55:35.449510 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.449512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.449519 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.449572 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.450659 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:35.450661 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:35.450662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:35.450666 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:35.450682 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:35.450686 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:35.450745 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:35.450815 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:55:35.450830 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:55:35.451073 10651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.448744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36153 (local address 127.0.124.130:47373)
0929 22:55:35.448910 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:35.448942 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:35.449398 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:35.449643 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:35.449647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:35.449657 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:35.450508 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:35.450508 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:35.450534 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:35.450558 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:35.450743 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:35.450747 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:35.450751 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:35.450815 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 22:55:35.450872 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
I20260929 22:55:35.451596 10649 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36153
I20260929 22:55:35.451685 10649 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:35.451802 10649 heartbeater.cc:511] Master 127.0.124.190:36153 requested a full tablet report, sending...
I20260929 22:55:35.452127 10329 ts_manager.cc:194] Registered new tserver with Master: 439ceef3249a4408b8baf99fd82d74b3 (127.0.124.130:33745)
I20260929 22:55:35.456614 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10521
I20260929 22:55:35.456683 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:35.456862 498 external_mini_cluster.cc:1428] Setting key 9506353231de9b1c449f826d0b725010
I20260929 22:55:35.457666 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--builtin_ntp_servers=127.0.124.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:55:35.537676 10652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:35.537945 10652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:35.537984 10652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:35.539160 10652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:35.539222 10652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:35.539276 10652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:35.540688 10652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:35.540941 10652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:35.541225 10652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:35.546123 10660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.546226 10652 server_base.cc:1034] running on GCE node
W20260929 22:55:35.546144 10657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:35.546134 10658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:35.546555 10652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:35.546788 10652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:35.547943 10652 hybrid_clock.cc:648] HybridClock initialized: now 1790722535547928 us; error 28 us; skew 500 ppm
I20260929 22:55:35.549196 10652 webserver.cc:460] Webserver started at http://127.0.124.131:45181/ using document root <none> and password file <none>
I20260929 22:55:35.549449 10652 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:35.549515 10652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:35.549657 10652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:35.550675 10652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "9f869bdcf8d4494c934f76aa350a7ea0"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "a1666f3ed5b35a312aaab1695ff0db03"
server_key_iv: "0b9adda85bf5c178cea37e1a0b5e747a"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.551011 10652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "9f869bdcf8d4494c934f76aa350a7ea0"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "a1666f3ed5b35a312aaab1695ff0db03"
server_key_iv: "0b9adda85bf5c178cea37e1a0b5e747a"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.552354 10652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:55:35.553025 10666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.553208 10652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:55:35.553300 10652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "9f869bdcf8d4494c934f76aa350a7ea0"
format_stamp: "Formatted at 2026-09-29 22:55:35 on dist-test-slave-512q"
server_key: "a1666f3ed5b35a312aaab1695ff0db03"
server_key_iv: "0b9adda85bf5c178cea37e1a0b5e747a"
server_key_version: "encryptionkey@0"
I20260929 22:55:35.553381 10652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:35.556574 10652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:35.556811 10652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:35.556942 10652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:35.557143 10652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:35.557415 10652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:35.557463 10652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.557500 10652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:35.557528 10652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:35.562882 10652 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:39531
I20260929 22:55:35.562925 10779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:39531 every 8 connection(s)
I20260929 22:55:35.563210 10652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:55:35.566073 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.563830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:55305 (local address 127.0.124.190:36153)
0929 22:55:35.563875 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.563878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.564115 (+ 237us) server_negotiation.cc:407] Connection header received
0929 22:55:35.564621 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.564622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.564626 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.564677 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.565832 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:35.565833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:35.565833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:55:35.565837 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:35.565848 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:55:35.565852 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:35.565913 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:35.565990 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 22:55:35.566004 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:55:35.566264 10782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:35.563820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36153 (local address 127.0.124.131:55305)
0929 22:55:35.563987 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:35.564019 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:35.564531 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:35.564744 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:35.564747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:35.564756 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:35.565674 (+ 918us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:55:35.565674 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:35.565700 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:55:35.565726 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:35.565910 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:35.565916 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:35.565919 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:35.565999 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:55:35.566056 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260929 22:55:35.566745 10780 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36153
I20260929 22:55:35.566830 10780 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:35.566938 10780 heartbeater.cc:511] Master 127.0.124.190:36153 requested a full tablet report, sending...
I20260929 22:55:35.567294 10329 ts_manager.cc:194] Registered new tserver with Master: 9f869bdcf8d4494c934f76aa350a7ea0 (127.0.124.131:39531)
I20260929 22:55:35.572063 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10652
I20260929 22:55:35.572160 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:35.572377 498 external_mini_cluster.cc:1428] Setting key 8b4c4514ff99701b00809b4375daf129
I20260929 22:55:35.573067 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:55:35.574944 10369 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:55:35.574418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47586 (local address 127.0.124.190:36153)
0929 22:55:35.574510 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:35.574512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:35.574639 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:55:35.574678 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:35.574679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:35.574684 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:35.574725 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:35.574898 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47586: BlockingRecv error: recv got EOF from 127.0.0.1:47586 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260929 22:55:35.575254 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10389
I20260929 22:55:35.579771 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10521
I20260929 22:55:35.585294 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10652
I20260929 22:55:35.589298 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10298
2026-09-29T22:55:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (538 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:35 dist-test-slave-512q krb5kdc[10790](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:35 dist-test-slave-512q krb5kdc[10790](info): set up 2 sockets
Sep 29 22:55:35 dist-test-slave-512q krb5kdc[10790](info): commencing operation
krb5kdc: starting...
W20260929 22:55:36.655259 498 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:36 dist-test-slave-512q krb5kdc[10790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:55:36.771160 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41381
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:41381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:36.852392 10803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:36.852588 10803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:36.852610 10803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:36.853708 10803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:55:36.853755 10803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:36.853770 10803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:36.853781 10803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:55:36.853793 10803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:55:36.855135 10803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:41381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:36.855309 10803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:36.855463 10803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:36.860275 10811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:36.860373 10803 server_base.cc:1034] running on GCE node
W20260929 22:55:36.860277 10808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:36.860442 10809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:36.860718 10803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:36.860991 10803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:36.862151 10803 hybrid_clock.cc:648] HybridClock initialized: now 1790722536862145 us; error 36 us; skew 500 ppm
Sep 29 22:55:36 dist-test-slave-512q krb5kdc[10790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722536, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:36.864459 10803 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:55:36.864921 10803 webserver.cc:460] Webserver started at http://127.0.124.190:34319/ using document root <none> and password file <none>
I20260929 22:55:36.865150 10803 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:36.865217 10803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:36.865357 10803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:36.866380 10803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "d9b83df689ce47b8af44c71616592134"
format_stamp: "Formatted at 2026-09-29 22:55:36 on dist-test-slave-512q"
server_key: "9a8875bc6b10abde6208e658e3f0a5c7"
server_key_iv: "f72d6112b96be6af3c96ff799c27a796"
server_key_version: "encryptionkey@0"
I20260929 22:55:36.866755 10803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "d9b83df689ce47b8af44c71616592134"
format_stamp: "Formatted at 2026-09-29 22:55:36 on dist-test-slave-512q"
server_key: "9a8875bc6b10abde6208e658e3f0a5c7"
server_key_iv: "f72d6112b96be6af3c96ff799c27a796"
server_key_version: "encryptionkey@0"
I20260929 22:55:36.868031 10803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:36.868837 10818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:36.869017 10803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:36.869113 10803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "d9b83df689ce47b8af44c71616592134"
format_stamp: "Formatted at 2026-09-29 22:55:36 on dist-test-slave-512q"
server_key: "9a8875bc6b10abde6208e658e3f0a5c7"
server_key_iv: "f72d6112b96be6af3c96ff799c27a796"
server_key_version: "encryptionkey@0"
I20260929 22:55:36.869199 10803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:36.877328 10803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:36.879010 10803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:36.879156 10803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:36.883132 10803 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:41381
I20260929 22:55:36.883160 10870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:41381 every 8 connection(s)
I20260929 22:55:36.883476 10803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:55:36.884428 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:36.885546 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10803
I20260929 22:55:36.885653 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:55:36.885846 498 external_mini_cluster.cc:1428] Setting key b0a25f96413a81f44822cc72c9da8fed
I20260929 22:55:36.887207 10871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: Bootstrap starting.
I20260929 22:55:36.887917 10871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:36.888273 10871 log.cc:824] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:36.888967 10871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: No bootstrap required, opened a new log
I20260929 22:55:36.891317 10871 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } }
I20260929 22:55:36.891497 10871 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:36.891533 10871 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9b83df689ce47b8af44c71616592134, State: Initialized, Role: FOLLOWER
I20260929 22:55:36.891667 10871 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } }
I20260929 22:55:36.891770 10871 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:55:36.891801 10871 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:55:36.891856 10871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:36.892575 10871 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } }
I20260929 22:55:36.892669 10871 leader_election.cc:302] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9b83df689ce47b8af44c71616592134; no voters:
I20260929 22:55:36.892829 10871 leader_election.cc:288] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:55:36.892868 10876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 1 FOLLOWER]: Leader election won for term 1
Sep 29 22:55:36 dist-test-slave-512q krb5kdc[10790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:36.893028 10876 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [term 1 LEADER]: Becoming Leader. State: Replica: d9b83df689ce47b8af44c71616592134, State: Running, Role: LEADER
I20260929 22:55:36.893090 10871 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:55:36.893107 10876 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } }
I20260929 22:55:36.893397 10876 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9b83df689ce47b8af44c71616592134. Latest consensus state: current_term: 1 leader_uuid: "d9b83df689ce47b8af44c71616592134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } } }
I20260929 22:55:36.893404 10877 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9b83df689ce47b8af44c71616592134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9b83df689ce47b8af44c71616592134" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41381 } } }
I20260929 22:55:36.893482 10876 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:36.893539 10877 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134 [sys.catalog]: This master's current role is: LEADER
I20260929 22:55:36.894187 10883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:55:36.894996 10883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:55:36.896461 10883 catalog_manager.cc:1347] Generated new cluster ID: ee62b88147b244f6a1e2b010c045ea8d
I20260929 22:55:36.896512 10883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:55:36.897666 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:36.886355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.0.124.190:41381)
0929 22:55:36.886551 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:36.886560 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:36.886591 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:55:36.887015 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:36.887021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:36.887066 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:36.887175 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:36.887955 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:36.889202 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:36.890241 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:36.890623 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:36.890699 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:36.893819 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:36.893823 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:36.893823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:36.893834 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:36.895855 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:36.896248 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:36.896251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:36.896251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:36.896351 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:36.896593 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:36.896594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:36.896594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:36.896870 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:36.896982 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:36.897359 (+ 377us) server_negotiation.cc:299] Negotiation successful
0929 22:55:36.897478 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260929 22:55:36.918603 10883 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:55:36.919175 10883 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:55:36.923573 10883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: Generated new TSK 0
I20260929 22:55:36.923758 10883 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:55:36.951061 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:37.043272 10897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:37.043471 10897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:37.043493 10897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:37.044617 10897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:37.044667 10897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:37.044695 10897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:55:37.046068 10897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:37.046247 10897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:37.046415 10897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:55:37.051182 10897 server_base.cc:1034] running on GCE node
W20260929 22:55:37.051128 10903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:37.051128 10902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:37.051165 10905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:37.051664 10897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:37.051901 10897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:37.053066 10897 hybrid_clock.cc:648] HybridClock initialized: now 1790722537053062 us; error 38 us; skew 500 ppm
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:37.055528 10897 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:55:37.055953 10897 webserver.cc:460] Webserver started at http://127.0.124.129:45391/ using document root <none> and password file <none>
I20260929 22:55:37.056170 10897 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:37.056258 10897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:37.056414 10897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:37.057478 10897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "565c713eba6846eea1e1c3fb408066e5"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "bcbf90ef41aa4a8be9ac141f39248ae9"
server_key_iv: "6662c6f370ceff55e4f14507ada44112"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.057829 10897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "565c713eba6846eea1e1c3fb408066e5"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "bcbf90ef41aa4a8be9ac141f39248ae9"
server_key_iv: "6662c6f370ceff55e4f14507ada44112"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.059113 10897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:55:37.059821 10912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.059986 10897 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:37.060079 10897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "565c713eba6846eea1e1c3fb408066e5"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "bcbf90ef41aa4a8be9ac141f39248ae9"
server_key_iv: "6662c6f370ceff55e4f14507ada44112"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.060158 10897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:37.085234 10897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:37.087370 10897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:37.087517 10897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:37.087688 10897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:37.087999 10897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:37.088065 10897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.088105 10897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:37.088150 10897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.094195 10897 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:34923
I20260929 22:55:37.094262 11025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:34923 every 8 connection(s)
I20260929 22:55:37.094563 10897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:55:37.096482 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 10897
I20260929 22:55:37.096598 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:55:37.096808 498 external_mini_cluster.cc:1428] Setting key 9695bac56b8060a1c3863e35130ea0c3
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
I20260929 22:55:37.104362 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.095267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:51275 (local address 127.0.124.190:41381)
0929 22:55:37.095313 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.095315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.095566 (+ 251us) server_negotiation.cc:407] Connection header received
0929 22:55:37.096012 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.096013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.096023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.096077 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:37.097302 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.097862 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.099287 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.099512 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.099600 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.101681 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:37.101682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:37.101683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:37.101690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:37.103039 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.103423 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.103424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.103425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.103482 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.103722 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.103723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.103723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.103828 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:37.103896 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.104142 (+ 246us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.104274 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:55:37.104521 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.095261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41381 (local address 127.0.124.129:51275)
0929 22:55:37.095428 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.095480 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.095930 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.096128 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.096131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.096945 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:37.097212 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.097217 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.097982 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.097983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.099186 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.099189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.099609 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.099610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.099736 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.100250 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:37.100260 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:37.101591 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:37.103131 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.103138 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.103140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.103352 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.103549 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.103550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.103551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.103653 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.103887 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:37.103892 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:37.104022 (+ 130us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.104122 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.104299 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260929 22:55:37.105005 11026 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41381
I20260929 22:55:37.105098 11026 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:37.105262 11026 heartbeater.cc:511] Master 127.0.124.190:41381 requested a full tablet report, sending...
I20260929 22:55:37.105782 10835 ts_manager.cc:194] Registered new tserver with Master: 565c713eba6846eea1e1c3fb408066e5 (127.0.124.129:34923)
I20260929 22:55:37.106364 10835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:51275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:55:37.120930 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:37.199973 11031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:37.200188 11031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:37.200219 11031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:37.201342 11031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:37.201406 11031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:37.201447 11031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:55:37.202812 11031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:37.203056 11031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:37.203266 11031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:37.208263 11036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:37.208360 11037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:37.208253 11039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:37.208498 11031 server_base.cc:1034] running on GCE node
I20260929 22:55:37.208703 11031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:37.208984 11031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:37.210145 11031 hybrid_clock.cc:648] HybridClock initialized: now 1790722537210131 us; error 31 us; skew 500 ppm
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:37.212663 11031 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:55:37.213078 11031 webserver.cc:460] Webserver started at http://127.0.124.130:37995/ using document root <none> and password file <none>
I20260929 22:55:37.213294 11031 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:37.213361 11031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:37.213512 11031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:37.214514 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "d8588b70fad046e09d8fd7abee851826"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "d24c5d31d261ad99a131545d46126ec7"
server_key_iv: "86b4e830caf8efba3ba124e0ffe6e7dc"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.214860 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "d8588b70fad046e09d8fd7abee851826"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "d24c5d31d261ad99a131545d46126ec7"
server_key_iv: "86b4e830caf8efba3ba124e0ffe6e7dc"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.216180 11031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:55:37.216991 11046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.217188 11031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:55:37.217283 11031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "d8588b70fad046e09d8fd7abee851826"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "d24c5d31d261ad99a131545d46126ec7"
server_key_iv: "86b4e830caf8efba3ba124e0ffe6e7dc"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.217358 11031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:37.242419 11031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:37.244802 11031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:37.244971 11031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:37.245214 11031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:37.245528 11031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:37.245581 11031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.245615 11031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:37.245641 11031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.251153 11031 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:42075
I20260929 22:55:37.251202 11159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:42075 every 8 connection(s)
I20260929 22:55:37.251516 11031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:55:37.255326 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 11031
I20260929 22:55:37.255425 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:55:37.255647 498 external_mini_cluster.cc:1428] Setting key f866771bf84b87b38b1b7e776c3844ed
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:37.261257 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.252205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:32923 (local address 127.0.124.190:41381)
0929 22:55:37.252287 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.252289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.252470 (+ 181us) server_negotiation.cc:407] Connection header received
0929 22:55:37.252910 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.252911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.252920 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.252976 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:37.253873 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.254404 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.255573 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.255824 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.255900 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.258460 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:37.258461 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:37.258462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:37.258469 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:37.259852 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.260301 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.260302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.260302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.260362 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.260645 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.260646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.260646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.260755 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:37.260823 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.261095 (+ 272us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.261173 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:55:37.261430 11162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.252187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41381 (local address 127.0.124.130:32923)
0929 22:55:37.252352 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.252387 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.252834 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.253037 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.253040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.253592 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:37.253779 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.253783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.254479 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.254479 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.255413 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.255416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.255927 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.255928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.256066 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.256616 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:37.256625 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:37.258350 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:37.259959 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.259964 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.259967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.260201 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.260429 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.260430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.260430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.260575 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.260826 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:37.260831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:37.260968 (+ 137us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.261062 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.261208 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260929 22:55:37.261868 11160 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41381
I20260929 22:55:37.261955 11160 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:37.262137 11160 heartbeater.cc:511] Master 127.0.124.190:41381 requested a full tablet report, sending...
I20260929 22:55:37.262493 10835 ts_manager.cc:194] Registered new tserver with Master: d8588b70fad046e09d8fd7abee851826 (127.0.124.130:42075)
I20260929 22:55:37.263023 10835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:32923
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:55:37.279551 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:55:37.359486 11165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:55:37.359709 11165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:55:37.359737 11165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:55:37.360934 11165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:55:37.360976 11165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:55:37.361006 11165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:55:37.362440 11165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:55:37.362639 11165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:55:37.362829 11165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:55:37.368371 11170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:55:37.368381 11171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:37.368567 11165 server_base.cc:1034] running on GCE node
W20260929 22:55:37.368371 11173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:55:37.368809 11165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:55:37.369050 11165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:55:37.370190 11165 hybrid_clock.cc:648] HybridClock initialized: now 1790722537370175 us; error 36 us; skew 500 ppm
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:55:37.372789 11165 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:55:37.373221 11165 webserver.cc:460] Webserver started at http://127.0.124.131:35841/ using document root <none> and password file <none>
I20260929 22:55:37.373443 11165 fs_manager.cc:359] Metadata directory not provided
I20260929 22:55:37.373517 11165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:55:37.373654 11165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:55:37.374579 11165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "a864cf0a33ad473f9599a864267451f4"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "b1b554c78f8dcff4a2d9bdc18d1d1d0c"
server_key_iv: "31cce8e3711a74e177edc49423623282"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.374958 11165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "a864cf0a33ad473f9599a864267451f4"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "b1b554c78f8dcff4a2d9bdc18d1d1d0c"
server_key_iv: "31cce8e3711a74e177edc49423623282"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.376329 11165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:55:37.377074 11180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.377228 11165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:55:37.377318 11165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "a864cf0a33ad473f9599a864267451f4"
format_stamp: "Formatted at 2026-09-29 22:55:37 on dist-test-slave-512q"
server_key: "b1b554c78f8dcff4a2d9bdc18d1d1d0c"
server_key_iv: "31cce8e3711a74e177edc49423623282"
server_key_version: "encryptionkey@0"
I20260929 22:55:37.377398 11165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:55:37.386116 11165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:55:37.387890 11165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:55:37.388043 11165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:55:37.388361 11165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:55:37.388659 11165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:55:37.388720 11165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.388754 11165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:55:37.388774 11165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:55:37.394971 11165 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:43347
I20260929 22:55:37.395004 11293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:43347 every 8 connection(s)
I20260929 22:55:37.395298 11165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[10790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722537, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:55:37.403923 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 11165
I20260929 22:55:37.404022 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:55:37.404246 498 external_mini_cluster.cc:1428] Setting key 9b9f7eeda5a7e5de88f397eba7373726
I20260929 22:55:37.404397 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.395958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:60627 (local address 127.0.124.190:41381)
0929 22:55:37.396013 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.396015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.396232 (+ 217us) server_negotiation.cc:407] Connection header received
0929 22:55:37.396771 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.396772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.396782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.396833 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:37.397844 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.398336 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.399314 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.399508 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.399588 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.401636 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:37.401638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:37.401638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:37.401645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:37.403012 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.403415 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.403416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.403417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.403476 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.403733 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.403734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.403735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.403847 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:37.403923 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.404228 (+ 305us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.404303 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:55:37.404620 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.395942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41381 (local address 127.0.124.131:60627)
0929 22:55:37.396111 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.396141 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.396661 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.396894 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.396897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.397500 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:55:37.397743 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.397748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.398453 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.398454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.399216 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.399217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.399604 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.399604 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.399722 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.400204 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:55:37.400249 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:55:37.401542 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:55:37.403108 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.403114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.403116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.403329 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.403542 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:55:37.403543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:55:37.403544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:55:37.403663 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:55:37.403914 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:55:37.403920 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:55:37.404064 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.404191 (+ 127us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.404362 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":79,"threads_started":1}
I20260929 22:55:37.405071 11294 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41381
I20260929 22:55:37.405154 11294 heartbeater.cc:464] Registering TS with master...
I20260929 22:55:37.405344 11294 heartbeater.cc:511] Master 127.0.124.190:41381 requested a full tablet report, sending...
I20260929 22:55:37.405680 10835 ts_manager.cc:194] Registered new tserver with Master: a864cf0a33ad473f9599a864267451f4 (127.0.124.131:43347)
I20260929 22:55:37.406056 10835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:60627
I20260929 22:55:37.416303 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:55:37.423385 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.417589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.0.124.190:41381)
0929 22:55:37.417648 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.417649 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.417722 (+ 73us) server_negotiation.cc:407] Connection header received
0929 22:55:37.417769 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.417770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.417777 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.417827 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:55:37.418308 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.418833 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.419523 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.419708 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.419755 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.420982 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:55:37.420983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:55:37.420983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:55:37.421004 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:55:37.422404 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.422752 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.422753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.422753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.422803 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:55:37.422953 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:55:37.422953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:55:37.422953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:55:37.423071 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:55:37.423154 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.423230 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.423282 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:55:37.424945 10835 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:55:37.426422 10835 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:55:37.432866 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.428848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.0.124.130:42075)
0929 22:55:37.428992 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.428998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.429137 (+ 139us) server_negotiation.cc:407] Connection header received
0929 22:55:37.429239 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.429242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.429256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.429349 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:37.429532 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.430388 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.431645 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.432426 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.432501 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.432553 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.432730 (+ 177us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.432777 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260929 22:55:37.432942 11310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.429154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40820 (local address 127.0.124.131:43347)
0929 22:55:37.429689 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.429693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.429702 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:37.429740 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.429742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.429753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.429812 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:37.429952 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.430726 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.431985 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.432600 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.432679 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.432737 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.432821 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.432858 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":81,"threads_started":1}
I20260929 22:55:37.433099 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.428765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:42075 (local address 127.0.0.1:44322)
0929 22:55:37.429015 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.429058 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.429153 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.429387 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.429390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.429392 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:37.429454 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.429455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.430482 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.430483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.431583 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.431585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.432522 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.432524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.432602 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.432617 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.432985 (+ 368us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.433035 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":47,"threads_started":1}
I20260929 22:55:37.433287 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.428953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:43347 (local address 127.0.0.1:40820)
0929 22:55:37.429311 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.429319 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.429375 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.429837 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.429838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.429840 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:37.429884 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.429886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.430839 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.430840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.431908 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.431910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.432686 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.432687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.432747 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.432751 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.432808 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.432862 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":70,"threads_started":1}
I20260929 22:55:37.433879 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 (DEFAULT_TABLE table=test-table [id=8e42afd3bfa14927a8c70bdc89f49797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:37.433951 11228 tablet_service.cc:1467] Processing CreateTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 (DEFAULT_TABLE table=test-table [id=8e42afd3bfa14927a8c70bdc89f49797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:37.434219 11228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fae5c41f9b4c9cb00fbee15f7188a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:37.434219 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fae5c41f9b4c9cb00fbee15f7188a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:37.437443 11311 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Bootstrap starting.
I20260929 22:55:37.438027 11306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.428770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34923 (local address 127.0.0.1:39918)
0929 22:55:37.429025 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.429081 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.429153 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.430479 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.430480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.430481 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:37.430527 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.430528 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.431775 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.431775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.432892 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.432894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.437868 (+ 4974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.437868 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.437915 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.437917 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.437955 (+ 38us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.437983 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":79,"threads_started":1}
I20260929 22:55:37.438140 11311 tablet_bootstrap.cc:654] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:37.438149 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.428858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39918 (local address 127.0.124.129:34923)
0929 22:55:37.429098 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.429101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.429160 (+ 59us) server_negotiation.cc:407] Connection header received
0929 22:55:37.429450 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.429453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.429469 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.429542 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:37.430603 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.431673 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.432995 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.437751 (+ 4756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.437791 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.437821 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.438003 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.438053 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":83,"threads_started":1}
I20260929 22:55:37.438704 11311 log.cc:824] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:37.438809 10960 tablet_service.cc:1467] Processing CreateTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 (DEFAULT_TABLE table=test-table [id=8e42afd3bfa14927a8c70bdc89f49797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:55:37.439031 11312 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Bootstrap starting.
I20260929 22:55:37.439178 10960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fae5c41f9b4c9cb00fbee15f7188a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:55:37.439555 11311 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: No bootstrap required, opened a new log
I20260929 22:55:37.439649 11311 ts_tablet_manager.cc:1397] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:55:37.439687 11312 tablet_bootstrap.cc:654] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:37.440544 11312 log.cc:824] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:37.441298 11312 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: No bootstrap required, opened a new log
I20260929 22:55:37.441365 11312 ts_tablet_manager.cc:1397] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:55:37.441284 11311 raft_consensus.cc:348] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.441499 11311 raft_consensus.cc:374] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:37.441543 11311 raft_consensus.cc:729] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8588b70fad046e09d8fd7abee851826, State: Initialized, Role: FOLLOWER
I20260929 22:55:37.441685 11311 consensus_queue.cc:260] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.441972 11311 ts_tablet_manager.cc:1428] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:55:37.442106 11160 heartbeater.cc:503] Master 127.0.124.190:41381 was elected leader, sending a full tablet report...
I20260929 22:55:37.442549 11316 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Bootstrap starting.
I20260929 22:55:37.443234 11316 tablet_bootstrap.cc:654] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Neither blocks nor log segments found. Creating new log.
I20260929 22:55:37.443356 11312 raft_consensus.cc:348] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.443507 11312 raft_consensus.cc:374] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:37.443531 11312 raft_consensus.cc:729] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a864cf0a33ad473f9599a864267451f4, State: Initialized, Role: FOLLOWER
I20260929 22:55:37.443641 11312 consensus_queue.cc:260] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.443837 11316 log.cc:824] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:55:37.443924 11294 heartbeater.cc:503] Master 127.0.124.190:41381 was elected leader, sending a full tablet report...
I20260929 22:55:37.443913 11312 ts_tablet_manager.cc:1428] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:55:37.444957 11316 tablet_bootstrap.cc:492] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: No bootstrap required, opened a new log
I20260929 22:55:37.445008 11316 ts_tablet_manager.cc:1397] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:55:37.446272 11316 raft_consensus.cc:348] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.446398 11316 raft_consensus.cc:374] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:55:37.446455 11316 raft_consensus.cc:729] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565c713eba6846eea1e1c3fb408066e5, State: Initialized, Role: FOLLOWER
I20260929 22:55:37.446563 11316 consensus_queue.cc:260] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.446846 11026 heartbeater.cc:503] Master 127.0.124.190:41381 was elected leader, sending a full tablet report...
I20260929 22:55:37.446846 11316 ts_tablet_manager.cc:1428] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260929 22:55:37.502067 11161 tablet.cc:2369] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:55:37.595299 11027 tablet.cc:2369] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:55:37.645856 11295 tablet.cc:2369] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:55:37.687640 11317 raft_consensus.cc:482] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:55:37.687757 11317 raft_consensus.cc:504] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.688301 11317 leader_election.cc:288] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8588b70fad046e09d8fd7abee851826 (127.0.124.130:42075), 565c713eba6846eea1e1c3fb408066e5 (127.0.124.129:34923)
I20260929 22:55:37.691102 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.688493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34923 (local address 127.0.124.131:44627)
0929 22:55:37.688557 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.688570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.688633 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.688821 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.688822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.688823 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:37.688899 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.688901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.689537 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.689538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.690292 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.690293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.690822 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.690909 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.690913 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.690977 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.691006 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260929 22:55:37.691121 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.688650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44627 (local address 127.0.124.129:34923)
0929 22:55:37.688692 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.688694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.688702 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:55:37.688731 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.688732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.688741 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.688807 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:37.688978 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.689458 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690384 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.690742 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690799 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.690805 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.690987 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.691049 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:55:37.691170 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.688611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:39737 (local address 127.0.124.130:42075)
0929 22:55:37.688654 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.688656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.688749 (+ 93us) server_negotiation.cc:407] Connection header received
0929 22:55:37.688819 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.688820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.688829 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.688888 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:55:37.689058 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.689510 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690430 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.690822 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690894 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.690901 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.691062 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.691099 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:55:37.691217 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.688515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:42075 (local address 127.0.124.131:39737)
0929 22:55:37.688666 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.688677 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:55:37.688743 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:55:37.688899 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:55:37.688900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:55:37.688901 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:55:37.688981 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.688983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.689589 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.689589 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.690315 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:55:37.690317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.690904 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.690905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:55:37.690980 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.690983 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:55:37.691041 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:55:37.691073 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260929 22:55:37.691448 10980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fae5c41f9b4c9cb00fbee15f7188a7" candidate_uuid: "a864cf0a33ad473f9599a864267451f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c713eba6846eea1e1c3fb408066e5" is_pre_election: true
I20260929 22:55:37.691541 11114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fae5c41f9b4c9cb00fbee15f7188a7" candidate_uuid: "a864cf0a33ad473f9599a864267451f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8588b70fad046e09d8fd7abee851826" is_pre_election: true
I20260929 22:55:37.691665 10980 raft_consensus.cc:2454] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a864cf0a33ad473f9599a864267451f4 in term 0.
I20260929 22:55:37.691704 11114 raft_consensus.cc:2454] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a864cf0a33ad473f9599a864267451f4 in term 0.
I20260929 22:55:37.691910 11184 leader_election.cc:302] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 565c713eba6846eea1e1c3fb408066e5, a864cf0a33ad473f9599a864267451f4; no voters:
I20260929 22:55:37.692070 11317 raft_consensus.cc:2781] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:55:37.692121 11317 raft_consensus.cc:482] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:55:37.692143 11317 raft_consensus.cc:3037] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:37.692947 11317 raft_consensus.cc:504] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.693080 11317 leader_election.cc:288] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [CANDIDATE]: Term 1 election: Requested vote from peers d8588b70fad046e09d8fd7abee851826 (127.0.124.130:42075), 565c713eba6846eea1e1c3fb408066e5 (127.0.124.129:34923)
I20260929 22:55:37.693192 11114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fae5c41f9b4c9cb00fbee15f7188a7" candidate_uuid: "a864cf0a33ad473f9599a864267451f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8588b70fad046e09d8fd7abee851826"
I20260929 22:55:37.693252 10980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fae5c41f9b4c9cb00fbee15f7188a7" candidate_uuid: "a864cf0a33ad473f9599a864267451f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c713eba6846eea1e1c3fb408066e5"
I20260929 22:55:37.693264 11114 raft_consensus.cc:3037] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:37.693301 10980 raft_consensus.cc:3037] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:55:37.693979 10980 raft_consensus.cc:2454] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a864cf0a33ad473f9599a864267451f4 in term 1.
I20260929 22:55:37.694082 11114 raft_consensus.cc:2454] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a864cf0a33ad473f9599a864267451f4 in term 1.
I20260929 22:55:37.694123 11184 leader_election.cc:302] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 565c713eba6846eea1e1c3fb408066e5, a864cf0a33ad473f9599a864267451f4; no voters:
I20260929 22:55:37.694208 11317 raft_consensus.cc:2781] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:55:37.694387 11317 raft_consensus.cc:686] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 1 LEADER]: Becoming Leader. State: Replica: a864cf0a33ad473f9599a864267451f4, State: Running, Role: LEADER
I20260929 22:55:37.694496 11317 consensus_queue.cc:237] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } }
I20260929 22:55:37.695344 10835 catalog_manager.cc:5495] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a864cf0a33ad473f9599a864267451f4 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "a864cf0a33ad473f9599a864267451f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a864cf0a33ad473f9599a864267451f4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 43347 } health_report { overall_health: HEALTHY } } }
I20260929 22:55:37.713899 11310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.711365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40826 (local address 127.0.124.131:43347)
0929 22:55:37.711425 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:55:37.711427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:55:37.711436 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:55:37.711533 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:55:37.711533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:55:37.711559 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:55:37.711639 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:55:37.711772 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.712292 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.713092 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:55:37.713287 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:55:37.713371 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:55:37.713544 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:55:37.713647 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:55:37.713735 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 22:55:37.713774 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:55:37.713793 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:55:37.715548 11114 raft_consensus.cc:1261] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 1 FOLLOWER]: Refusing update from remote peer a864cf0a33ad473f9599a864267451f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:37.715584 10980 raft_consensus.cc:1261] T 91fae5c41f9b4c9cb00fbee15f7188a7 P 565c713eba6846eea1e1c3fb408066e5 [term 1 FOLLOWER]: Refusing update from remote peer a864cf0a33ad473f9599a864267451f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:55:37.715880 11321 consensus_queue.cc:1035] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8588b70fad046e09d8fd7abee851826" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:37.716055 11317 consensus_queue.cc:1035] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565c713eba6846eea1e1c3fb408066e5" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:55:37.720690 10835 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:37.720784 10835 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:55:37.721486 10835 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9b83df689ce47b8af44c71616592134: Sending DeleteTablet for 3 replicas of tablet 91fae5c41f9b4c9cb00fbee15f7188a7
I20260929 22:55:37.721869 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:37 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:44322
I20260929 22:55:37.722235 11334 tablet_replica.cc:330] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: stopping tablet replica
I20260929 22:55:37.722348 11334 raft_consensus.cc:2229] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:55:37.722508 11334 raft_consensus.cc:2258] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:37.723018 10960 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:37 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:39918
I20260929 22:55:37.723043 11228 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fae5c41f9b4c9cb00fbee15f7188a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:55:37 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:40820
I20260929 22:55:37.723172 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10897
I20260929 22:55:37.725378 11334 ts_tablet_manager.cc:1905] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:37.726869 11334 ts_tablet_manager.cc:1918] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:37.726956 11334 log.cc:1196] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/91fae5c41f9b4c9cb00fbee15f7188a7
I20260929 22:55:37.727180 11334 ts_tablet_manager.cc:1939] T 91fae5c41f9b4c9cb00fbee15f7188a7 P d8588b70fad046e09d8fd7abee851826: Deleting consensus metadata
I20260929 22:55:37.727571 10821 catalog_manager.cc:4841] TS d8588b70fad046e09d8fd7abee851826 (127.0.124.130:42075): tablet 91fae5c41f9b4c9cb00fbee15f7188a7 (table test-table [id=8e42afd3bfa14927a8c70bdc89f49797]) successfully deleted
I20260929 22:55:37.728322 11336 tablet_replica.cc:330] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: stopping tablet replica
I20260929 22:55:37.728425 11336 raft_consensus.cc:2229] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:55:37.728535 11336 raft_consensus.cc:2258] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:55:37.728886 11336 ts_tablet_manager.cc:1905] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:55:37.730813 11336 ts_tablet_manager.cc:1918] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:55:37.730885 11336 log.cc:1196] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/91fae5c41f9b4c9cb00fbee15f7188a7
I20260929 22:55:37.731191 11336 ts_tablet_manager.cc:1939] T 91fae5c41f9b4c9cb00fbee15f7188a7 P a864cf0a33ad473f9599a864267451f4: Deleting consensus metadata
I20260929 22:55:37.731560 10822 catalog_manager.cc:4841] TS a864cf0a33ad473f9599a864267451f4 (127.0.124.131:43347): tablet 91fae5c41f9b4c9cb00fbee15f7188a7 (table test-table [id=8e42afd3bfa14927a8c70bdc89f49797]) successfully deleted
W20260929 22:55:37.732302 10822 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:34923 (error 108)
I20260929 22:55:37.732513 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 11031
I20260929 22:55:37.733310 11306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:55:37.732639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34923 (local address 127.0.0.1:39920)
0929 22:55:37.733222 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0929 22:55:37.733280 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:34923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563}
W20260929 22:55:37.733417 10822 catalog_manager.cc:4584] TS 565c713eba6846eea1e1c3fb408066e5 (127.0.124.129:34923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91fae5c41f9b4c9cb00fbee15f7188a7: Network error: Client connection negotiation failed: client connection to 127.0.124.129:34923: connect: Connection refused (error 111)
I20260929 22:55:37.739780 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 11165
I20260929 22:55:37.744913 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 10803
2026-09-29T22:55:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2156 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[11340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[11340](info): set up 2 sockets
Sep 29 22:55:37 dist-test-slave-512q krb5kdc[11340](info): commencing operation
krb5kdc: starting...
W20260929 22:55:38.775681 498 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:55:38 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:55:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:55:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangeradmin_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangeradmin_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangerlookup_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangerlookup_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
I20260929 22:55:38.934221 498 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZ2hK39/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/postgres -l logfile start
2026-09-29 22:55:41.344 UTC [11370] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 22:55:41.344 UTC [11370] LOG: listening on IPv4 address "127.0.124.148", port 38183
2026-09-29 22:55:41.347 UTC [11370] LOG: listening on Unix socket "/tmp/.s.PGSQL.38183"
2026-09-29 22:55:41.367 UTC [11373] LOG: database system was shut down at 2026-09-29 22:55:40 UTC
2026-09-29 22:55:41.371 UTC [11370] LOG: database system is ready to accept connections
I20260929 22:55:42.331364 498 mini_postgres.cc:96] Postgres bound to 38183
2026-09-29 22:55:42.337 UTC [11381] FATAL: database "slave" does not exist
127.0.124.148:38183 - accepting connections
I20260929 22:55:42.338503 498 mini_ranger.cc:161] Starting Ranger...
I20260929 22:55:42.353305 498 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 22:55:42.836786 498 mini_ranger.cc:87] Created ranger Postgres database
I20260929 22:55:42.836884 498 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin
2026-09-29 22:55:43,106 [I] DB FLAVOR :POSTGRES
2026-09-29 22:55:43,107 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:55:43,107 [I] Checking connection..
2026-09-29 22:55:43,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 22:55:43,368 [I] Checking connection passed.
2026-09-29 22:55:43,368 [I] --------- Verifying version history table ---------
2026-09-29 22:55:43,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:55:43,608 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:55:43,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:55:43,855 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:55:43,855 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 22:55:43,855 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 22:55:44.086 UTC [11445] WARNING: there is no transaction in progress
2026-09-29 22:55:44,092 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 22:55:44,093 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:55:44,326 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 22:55:44,326 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:55:44,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 22:55:44,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 22:55:44,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-512q.c.gcp-upstream.internal','N') ;"
2026-09-29 22:55:45,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:55:45,312 [I] Table x_portal_user does not exist in database ranger
2026-09-29 22:55:45,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:55:45,544 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 22:55:45,544 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:55:45,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:55:46,029 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 22:55:46,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 22:55:46.935 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:46.950 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:46.966 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:46.980 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:46.995 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.010 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.060 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.066 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.078 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.088 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.097 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.110 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.120 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.126 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.132 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47.138 UTC [11553] WARNING: there is no transaction in progress
2026-09-29 22:55:47,737 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 22:55:47,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 22:55:47,983 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 22:55:47,984 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:55:48,211 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 22:55:48,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:55:48,467 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 22:55:48,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:55:48,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:55:48,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-512q.c.gcp-upstream.internal';"
2026-09-29 22:55:49,178 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 22:55:49,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 22:55:49,428 [I] DB_PATCHES have already been applied
I20260929 22:55:49.435447 498 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZ2hK39/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 22:55:49.435531 498 mini_ranger.cc:193] Using host: 127.0.124.148
I20260929 22:55:49.438732 498 mini_ranger.cc:227] Ranger admin URL: http://127.0.124.148:60261
Sep 29, 2026 10:55:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:55:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:55:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 10:55:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 10:55:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 10:55:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 10:55:50 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 22:55:50.557337 498 mini_ranger.cc:160] Time spent starting Ranger: real 8.219s user 0.000s sys 0.009s
Sep 29, 2026 10:56:10 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 10:56:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 29, 2026 10:56:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 10:56:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 10:56:11 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 22:56:12.108711 498 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangerkms_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/rangerkms_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.124.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.124.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 22:56:12 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722572, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 22:56:12.195113 498 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 22:56:12.203775 498 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 22:56:13.008329 498 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 22:56:13.008409 498 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms
I20260929 22:56:13.008426 498 mini_ranger_kms.cc:227] Using postgres at 127.0.124.148:38183
2026-09-29 22:56:13,188 [I] DB FLAVOR :POSTGRES
2026-09-29 22:56:13,188 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:56:13,188 [I] Checking connection
2026-09-29 22:56:13,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 22:56:13,439 [I] connection success
2026-09-29 22:56:13,439 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 22:56:13,439 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 22:56:13,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 22:56:13,665 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 22:56:13,665 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:56:13,665 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 22:56:13,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:38183/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 22:56:13,928 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 22:56:14.366974 498 mini_ranger_kms.cc:310] Created kms service
I20260929 22:56:14.535506 498 mini_ranger_kms.cc:326] Created kudu user
I20260929 22:56:14.579507 498 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 22:56:14 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722572, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:56:14.965302 498 mini_ranger_kms.cc:384] Added ranger policy
I20260929 22:56:14.965409 498 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 22:56:14.965433 498 mini_ranger_kms.cc:240] Using host: 127.0.124.148
I20260929 22:56:14.968863 498 mini_ranger_kms.cc:276] Ranger KMS PID: 11733
I20260929 22:56:14.968988 498 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.124.148:57215
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 10:56:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 22:56:17.261000 498 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.066s user 0.001s sys 0.162s
I20260929 22:56:17.261090 498 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 22:56:17.261176 498 mini_ranger_kms.cc:401] 127.0.124.148:57215/kms/v1/keys
Sep 29 22:56:17 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 22:56:17 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
Sep 29 22:56:18 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
Sep 29 22:56:20 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:56:20.469226 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34313
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34313
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:57215/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:56:20.554450 11784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:56:20.554661 11784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:56:20.554683 11784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:56:20.555824 11784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:56:20.555866 11784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:56:20.555881 11784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:56:20.555892 11784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:56:20.555940 11784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:56:20.557466 11784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.124.148:57215/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34313
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:56:20.557699 11784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:56:20.557930 11784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:56:20.563606 11790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:20.563651 11789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:20.563730 11792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:56:20.563796 11784 server_base.cc:1034] running on GCE node
I20260929 22:56:20.564031 11784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:56:20.564344 11784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:56:20.565500 11784 hybrid_clock.cc:648] HybridClock initialized: now 1790722580565470 us; error 43 us; skew 500 ppm
Sep 29 22:56:20 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722580, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:56:20.568346 11784 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:56:20.568765 11784 webserver.cc:460] Webserver started at http://127.0.124.190:38107/ using document root <none> and password file <none>
I20260929 22:56:20.569011 11784 fs_manager.cc:359] Metadata directory not provided
I20260929 22:56:20.569072 11784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:56:20.569226 11784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:56:20 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722580, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:56:20.611819 11784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "7c89caf6c9f14f0eadb67046f545898d"
format_stamp: "Formatted at 2026-09-29 22:56:20 on dist-test-slave-512q"
server_key: "277e14fd2014a7aec29ae33689f2a544"
server_key_iv: "5de9f4b5820223e2cfb1540db7cec7be"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:20.612257 11784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "7c89caf6c9f14f0eadb67046f545898d"
format_stamp: "Formatted at 2026-09-29 22:56:20 on dist-test-slave-512q"
server_key: "277e14fd2014a7aec29ae33689f2a544"
server_key_iv: "5de9f4b5820223e2cfb1540db7cec7be"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:20.613798 11784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:56:20.624670 11799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:20.624861 11784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:56:20.624950 11784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "7c89caf6c9f14f0eadb67046f545898d"
format_stamp: "Formatted at 2026-09-29 22:56:20 on dist-test-slave-512q"
server_key: "277e14fd2014a7aec29ae33689f2a544"
server_key_iv: "5de9f4b5820223e2cfb1540db7cec7be"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:20.625064 11784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:56:20.644863 11784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:56:20.646868 11784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:56:20.647027 11784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:56:20.651859 11784 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:34313
I20260929 22:56:20.651885 11851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:34313 every 8 connection(s)
I20260929 22:56:20.652292 11784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:56:20.653066 11852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:56:20.655021 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 11784
I20260929 22:56:20.655134 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:56:20.655320 498 external_mini_cluster.cc:1428] Setting key 0d543ed70a3e8d84e8b0c91ca3d88f6e
I20260929 22:56:20.656046 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: Bootstrap starting.
I20260929 22:56:20.656741 11852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: Neither blocks nor log segments found. Creating new log.
I20260929 22:56:20.657341 11852 log.cc:824] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:56:20.658120 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: No bootstrap required, opened a new log
I20260929 22:56:20.660581 11852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } }
I20260929 22:56:20.660790 11852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:56:20.660828 11852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c89caf6c9f14f0eadb67046f545898d, State: Initialized, Role: FOLLOWER
I20260929 22:56:20.661001 11852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } }
I20260929 22:56:20.661087 11852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:56:20.661118 11852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:56:20.661182 11852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 0 FOLLOWER]: Advancing to term 1
Sep 29 22:56:20 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:56:20.661808 11852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } }
I20260929 22:56:20.661914 11852 leader_election.cc:302] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c89caf6c9f14f0eadb67046f545898d; no voters:
I20260929 22:56:20.662072 11852 leader_election.cc:288] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:56:20.662400 11852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:56:20.662114 11857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:56:20.663741 11857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [term 1 LEADER]: Becoming Leader. State: Replica: 7c89caf6c9f14f0eadb67046f545898d, State: Running, Role: LEADER
I20260929 22:56:20.663853 11857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } }
I20260929 22:56:20.664188 11857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c89caf6c9f14f0eadb67046f545898d. Latest consensus state: current_term: 1 leader_uuid: "7c89caf6c9f14f0eadb67046f545898d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } } }
I20260929 22:56:20.664306 11857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [sys.catalog]: This master's current role is: LEADER
I20260929 22:56:20.664690 11858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c89caf6c9f14f0eadb67046f545898d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c89caf6c9f14f0eadb67046f545898d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34313 } } }
I20260929 22:56:20.664721 11871 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:56:20.664754 11858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d [sys.catalog]: This master's current role is: LEADER
I20260929 22:56:20.665100 11852 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:56:20.669121 11855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:20.655816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.0.124.190:34313)
0929 22:56:20.656031 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:20.656040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:20.656069 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:56:20.656583 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:20.656590 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:20.656638 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:20.656782 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:56:20.657383 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:20.658498 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:20.659256 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:20.659677 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:20.659805 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:20.662198 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:56:20.662202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:56:20.662202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:56:20.662214 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:56:20.664114 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:20.664527 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:20.664530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:20.664530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:20.664626 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:20.664831 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:20.664831 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:20.664832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:20.665120 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:56:20.665263 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:20.665507 (+ 244us) server_negotiation.cc:299] Negotiation successful
0929 22:56:20.668577 (+ 3070us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260929 22:56:20.668812 11871 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:56:20.671670 11871 catalog_manager.cc:1347] Generated new cluster ID: c61dc7cf84cf492d8e860ef61c69407d
I20260929 22:56:20.671721 11871 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:56:20.681834 11871 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:56:20.682654 11871 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:56:20.691382 11871 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: Generated new TSK 0
I20260929 22:56:20.691629 11871 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:56:21.385298 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:57215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:56:21.475744 11897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:56:21.476003 11897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:56:21.476042 11897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:56:21.477283 11897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:56:21.477350 11897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:56:21.477393 11897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:56:21.478957 11897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.124.148:57215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:56:21.479202 11897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:56:21.479434 11897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:56:21.485520 11902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:21.485553 11903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:21.485714 11905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:56:21.485754 11897 server_base.cc:1034] running on GCE node
I20260929 22:56:21.486135 11897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:56:21.486380 11897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:56:21.487543 11897 hybrid_clock.cc:648] HybridClock initialized: now 1790722581487531 us; error 31 us; skew 500 ppm
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:56:21.490209 11897 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:56:21.490643 11897 webserver.cc:460] Webserver started at http://127.0.124.129:44819/ using document root <none> and password file <none>
I20260929 22:56:21.490883 11897 fs_manager.cc:359] Metadata directory not provided
I20260929 22:56:21.490948 11897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:56:21.491086 11897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:56:21.504333 11897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "124fd26505194ca2bcbd053dde3a8663"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "293a4682743187e4bdae5912a248ac56"
server_key_iv: "37c661a38788a29f6473485ac81cdfe1"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.504916 11897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "124fd26505194ca2bcbd053dde3a8663"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "293a4682743187e4bdae5912a248ac56"
server_key_iv: "37c661a38788a29f6473485ac81cdfe1"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.506738 11897 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260929 22:56:21.524207 11912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.524493 11897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:56:21.524597 11897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "124fd26505194ca2bcbd053dde3a8663"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "293a4682743187e4bdae5912a248ac56"
server_key_iv: "37c661a38788a29f6473485ac81cdfe1"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.524684 11897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:56:21.542083 11897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:56:21.544526 11897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:56:21.544660 11897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:56:21.544904 11897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:56:21.545248 11897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:56:21.545301 11897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.545332 11897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:56:21.545356 11897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.551610 11897 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:42221
I20260929 22:56:21.552032 11897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:56:21.552556 12025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:42221 every 8 connection(s)
I20260929 22:56:21.554826 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 11897
I20260929 22:56:21.554941 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:56:21.555154 498 external_mini_cluster.cc:1428] Setting key 03106ca85e1badce978473388862867c
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
I20260929 22:56:21.567431 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:21.553591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:45631 (local address 127.0.124.190:34313)
0929 22:56:21.556321 (+ 2730us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:21.556323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:21.556332 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:56:21.556354 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:21.556355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:21.556367 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:21.558034 (+ 1667us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:56:21.558077 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.558882 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.560473 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.560811 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.560855 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:21.563617 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:56:21.563618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:56:21.563618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:56:21.563627 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:56:21.565643 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:21.566161 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:21.566162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:21.566163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:21.566231 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:21.566575 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:21.566576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:21.566577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:21.566726 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:56:21.566779 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:21.567210 (+ 431us) server_negotiation.cc:299] Negotiation successful
0929 22:56:21.567304 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2697,"thread_start_us":89,"threads_started":1}
I20260929 22:56:21.567940 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:21.553580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34313 (local address 127.0.124.129:45631)
0929 22:56:21.553777 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:21.553825 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:21.554446 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:21.556562 (+ 2116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:21.556567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:21.556809 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:56:21.557083 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:21.557938 (+ 855us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.559004 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.559006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:21.560342 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:21.560345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.560950 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.560951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:21.561092 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:21.561742 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:56:21.561752 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:56:21.563491 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:56:21.565752 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:21.565758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:21.565761 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:21.566059 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:21.566316 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:21.566317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:21.566317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:21.566482 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:21.566854 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:56:21.566861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:56:21.567026 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 22:56:21.567536 (+ 510us) client_negotiation.cc:240] Negotiation successful
0929 22:56:21.567712 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":68,"threads_started":1}
I20260929 22:56:21.568677 12026 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34313
I20260929 22:56:21.568774 12026 heartbeater.cc:464] Registering TS with master...
I20260929 22:56:21.568953 12026 heartbeater.cc:511] Master 127.0.124.190:34313 requested a full tablet report, sending...
I20260929 22:56:21.569533 11816 ts_manager.cc:194] Registered new tserver with Master: 124fd26505194ca2bcbd053dde3a8663 (127.0.124.129:42221)
I20260929 22:56:21.570464 11816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:45631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:56:21.591925 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:57215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:56:21.698544 12034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:56:21.698855 12034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:56:21.698890 12034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:56:21.700636 12034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:56:21.700691 12034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:56:21.700728 12034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:56:21.702814 12034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.124.148:57215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:56:21.703054 12034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:56:21.703326 12034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:56:21.709400 12044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:21.709580 12041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:56:21.709844 12034 server_base.cc:1034] running on GCE node
W20260929 22:56:21.709509 12042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:56:21.710160 12034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:56:21.710444 12034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:56:21.711627 12034 hybrid_clock.cc:648] HybridClock initialized: now 1790722581711597 us; error 42 us; skew 500 ppm
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:56:21.714994 12034 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:56:21.715502 12034 webserver.cc:460] Webserver started at http://127.0.124.130:38667/ using document root <none> and password file <none>
I20260929 22:56:21.715785 12034 fs_manager.cc:359] Metadata directory not provided
I20260929 22:56:21.715858 12034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:56:21.716056 12034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:56:21.731699 12034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "730afc248cdb4e0d9fddb53283f3d198"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "3dde94affa56e3474bc5b499aea69b07"
server_key_iv: "2d29ad7b638b3820cdae82f699979823"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.732153 12034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "730afc248cdb4e0d9fddb53283f3d198"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "3dde94affa56e3474bc5b499aea69b07"
server_key_iv: "2d29ad7b638b3820cdae82f699979823"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.734426 12034 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:56:21.747946 12051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.748209 12034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:56:21.748366 12034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "730afc248cdb4e0d9fddb53283f3d198"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "3dde94affa56e3474bc5b499aea69b07"
server_key_iv: "2d29ad7b638b3820cdae82f699979823"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.748522 12034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:56:21.764650 12034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:56:21.767057 12034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:56:21.767197 12034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:56:21.767457 12034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:56:21.767885 12034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:56:21.767980 12034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.768051 12034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:56:21.768107 12034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:21.774531 12034 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:46703
I20260929 22:56:21.774984 12034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:56:21.777537 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 12034
I20260929 22:56:21.777642 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:56:21.777830 498 external_mini_cluster.cc:1428] Setting key 17f4be85d07cc96d61ef9eb3848cb12d
I20260929 22:56:21.777810 12164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:46703 every 8 connection(s)
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:56:21.789364 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:21.778957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:35621 (local address 127.0.124.190:34313)
0929 22:56:21.779011 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:21.779014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:21.779375 (+ 361us) server_negotiation.cc:407] Connection header received
0929 22:56:21.780032 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:21.780033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:21.780050 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:21.780079 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:56:21.780910 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.781695 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.783220 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.783539 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.783580 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:21.786084 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:56:21.786085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:56:21.786085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:56:21.786092 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:56:21.787752 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:21.788202 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:21.788234 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:21.788235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:21.788295 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:21.788601 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:21.788602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:21.788602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:21.788738 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:56:21.788783 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:21.789143 (+ 360us) server_negotiation.cc:299] Negotiation successful
0929 22:56:21.789252 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:56:21.790117 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:21.778980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34313 (local address 127.0.124.130:35621)
0929 22:56:21.779261 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:21.779300 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:21.779908 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:21.780280 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:21.780284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:21.780519 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:56:21.780800 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:21.780807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.781809 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.781810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:21.783079 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:21.783081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:21.783664 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:21.783665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:21.783798 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:21.784418 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:56:21.784427 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:56:21.785980 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:56:21.787844 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:21.787850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:21.787852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:21.788118 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:21.788382 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:21.788382 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:21.788383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:21.788525 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:21.788828 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:56:21.788833 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:56:21.788990 (+ 157us) client_negotiation.cc:769] Sending connection context
0929 22:56:21.789697 (+ 707us) client_negotiation.cc:240] Negotiation successful
0929 22:56:21.789862 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":92,"threads_started":1}
I20260929 22:56:21.790827 12165 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34313
I20260929 22:56:21.790920 12165 heartbeater.cc:464] Registering TS with master...
I20260929 22:56:21.791105 12165 heartbeater.cc:511] Master 127.0.124.190:34313 requested a full tablet report, sending...
I20260929 22:56:21.791558 11816 ts_manager.cc:194] Registered new tserver with Master: 730afc248cdb4e0d9fddb53283f3d198 (127.0.124.130:46703)
I20260929 22:56:21.791939 11816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:35621
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:56:21.825312 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:57215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:56:21.945086 12171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:56:21.945377 12171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:56:21.945412 12171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:56:21.947081 12171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:56:21.947147 12171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:56:21.947189 12171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:56:21.949364 12171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.124.148:57215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:56:21.949611 12171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:56:21.949903 12171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:56:21.956261 12176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:21.956429 12177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:56:21.956198 12179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:56:21.957307 12171 server_base.cc:1034] running on GCE node
I20260929 22:56:21.957618 12171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:56:21.957906 12171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:56:21.959087 12171 hybrid_clock.cc:648] HybridClock initialized: now 1790722581959058 us; error 42 us; skew 500 ppm
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:56:21.962574 12171 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:56:21.963092 12171 webserver.cc:460] Webserver started at http://127.0.124.131:43951/ using document root <none> and password file <none>
I20260929 22:56:21.963398 12171 fs_manager.cc:359] Metadata directory not provided
I20260929 22:56:21.963495 12171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:56:21.963670 12171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:56:21 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:56:21.985565 12171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "efe62a171b274d4da073e5f3681914bb"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "e429466b70907c7cd570622dd805de07"
server_key_iv: "3091b9e7692443b86ae87ba9245bebbb"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:21.986035 12171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "efe62a171b274d4da073e5f3681914bb"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "e429466b70907c7cd570622dd805de07"
server_key_iv: "3091b9e7692443b86ae87ba9245bebbb"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:22.000350 12171 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.002s sys 0.001s
I20260929 22:56:22.015115 12186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:22.015360 12171 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:56:22.015457 12171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "efe62a171b274d4da073e5f3681914bb"
format_stamp: "Formatted at 2026-09-29 22:56:21 on dist-test-slave-512q"
server_key: "e429466b70907c7cd570622dd805de07"
server_key_iv: "3091b9e7692443b86ae87ba9245bebbb"
server_key_version: "kuduclusterkey@0"
I20260929 22:56:22.015570 12171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:56:22.043758 12171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:56:22.046000 12171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:56:22.046164 12171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:56:22.046409 12171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:56:22.046799 12171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:56:22.046851 12171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:22.046888 12171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:56:22.046913 12171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:56:22.054241 12171 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:34165
I20260929 22:56:22.054630 12171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:56:22.055084 12299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:34165 every 8 connection(s)
I20260929 22:56:22.055763 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 12171
I20260929 22:56:22.055853 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:56:22.056042 498 external_mini_cluster.cc:1428] Setting key ce036c415aba5656ff5a4807f22ff42d
Sep 29 22:56:22 dist-test-slave-512q krb5kdc[11340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:56:22.074151 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.056304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:58333 (local address 127.0.124.190:34313)
0929 22:56:22.056408 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.056410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.056418 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:56:22.056439 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.056440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.056450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.056530 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:56:22.057323 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.057833 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.067669 (+ 9836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.067997 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.068045 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.070775 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:56:22.070777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:56:22.070777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:56:22.070784 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:56:22.072573 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:22.073068 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:22.073070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:22.073070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:22.073131 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:22.073404 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:22.073405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:22.073405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:22.073546 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:56:22.073596 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.073950 (+ 354us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.074042 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260929 22:56:22.074747 12302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.055408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34313 (local address 127.0.124.131:58333)
0929 22:56:22.055568 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.055607 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.056284 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.056591 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.056595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.056932 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:56:22.057229 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.057236 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.057928 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.057929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.067576 (+ 9647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.067579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.068139 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.068141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.068296 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.068902 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:56:22.068912 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:56:22.070666 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:56:22.072675 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:22.072681 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:22.072684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:22.072973 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:22.073197 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:56:22.073197 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:56:22.073198 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:56:22.073319 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:56:22.073628 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:56:22.073633 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:56:22.073808 (+ 175us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.074275 (+ 467us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.074532 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260929 22:56:22.075177 12300 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34313
I20260929 22:56:22.075273 12300 heartbeater.cc:464] Registering TS with master...
I20260929 22:56:22.075474 12300 heartbeater.cc:511] Master 127.0.124.190:34313 requested a full tablet report, sending...
I20260929 22:56:22.075811 11816 ts_manager.cc:194] Registered new tserver with Master: efe62a171b274d4da073e5f3681914bb (127.0.124.131:34165)
I20260929 22:56:22.076311 11816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:58333
I20260929 22:56:22.078697 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:56:22.088008 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.080491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.0.124.190:34313)
0929 22:56:22.080543 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.080544 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.080721 (+ 177us) server_negotiation.cc:407] Connection header received
0929 22:56:22.080813 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.080813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.080822 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.080849 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:56:22.081546 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.082263 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.083334 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.083634 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.083675 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.085114 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:56:22.085115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:56:22.085116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:56:22.085122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:56:22.086708 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:22.087107 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:22.087108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:22.087109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:22.087192 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:56:22.087417 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:56:22.087418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:56:22.087418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:56:22.087535 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:56:22.087608 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.087846 (+ 238us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.087920 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:56:22.090235 11816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:56:22.092557 11816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:56:22.101348 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.095665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:46703 (local address 127.0.0.1:60368)
0929 22:56:22.096183 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.096248 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.096313 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.096968 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.096971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.096974 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:56:22.097039 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.097041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.098392 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.098394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.099698 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.099701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.101062 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.101063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.101140 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.101154 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.101205 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.101257 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":88,"threads_started":1}
I20260929 22:56:22.101442 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.095666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:34165 (local address 127.0.0.1:44030)
0929 22:56:22.096196 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.096263 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.096788 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.097399 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.097399 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.097401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:56:22.097430 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.097431 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.098895 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.098896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.100071 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.100073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.101240 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.101240 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.101289 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.101292 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.101342 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.101379 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":9,"thread_start_us":90,"threads_started":1}
I20260929 22:56:22.101686 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.095957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.0.124.131:34165)
0929 22:56:22.096137 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.096142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.096853 (+ 711us) server_negotiation.cc:407] Connection header received
0929 22:56:22.096914 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.096917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.096934 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.097010 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:56:22.097528 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.098795 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.100276 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.101016 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.101099 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.101183 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.101542 (+ 359us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.101603 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
I20260929 22:56:22.102027 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.096605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.0.124.130:46703)
0929 22:56:22.096788 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.096792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.096802 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:56:22.096840 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.096842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.096858 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.097106 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:56:22.097172 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.098265 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.100190 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.100965 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.101799 (+ 834us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.101884 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.101920 (+ 36us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.101952 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260929 22:56:22.102346 12234 tablet_service.cc:1467] Processing CreateTablet for tablet 60548b1203114b258a60bab2b69e4bd1 (DEFAULT_TABLE table=test-table [id=c5dc4ffd17b24f05852b8a02ab95dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:56:22.102648 12099 tablet_service.cc:1467] Processing CreateTablet for tablet 60548b1203114b258a60bab2b69e4bd1 (DEFAULT_TABLE table=test-table [id=c5dc4ffd17b24f05852b8a02ab95dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:56:22.102761 12234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60548b1203114b258a60bab2b69e4bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:56:22.102985 12099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60548b1203114b258a60bab2b69e4bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:56:22.106093 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.095891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:42221 (local address 127.0.0.1:48120)
0929 22:56:22.096537 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.096547 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.096680 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.097272 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.097272 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.097275 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:56:22.097321 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.097322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.100045 (+ 2723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.100046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.104801 (+ 4755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.104804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.105877 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.105878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.105935 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.105939 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.105988 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.106028 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":3,"thread_start_us":74,"threads_started":1}
I20260929 22:56:22.106271 12320 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Bootstrap starting.
I20260929 22:56:22.106475 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.096018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48120 (local address 127.0.124.129:42221)
0929 22:56:22.096449 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.096453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.096645 (+ 192us) server_negotiation.cc:407] Connection header received
0929 22:56:22.097111 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.097114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.097129 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.097204 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:56:22.098925 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.099946 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.104902 (+ 4956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.105719 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.105788 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.105843 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.106346 (+ 503us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.106405 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":53,"threads_started":1}
I20260929 22:56:22.107220 12319 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Bootstrap starting.
I20260929 22:56:22.107225 11948 tablet_service.cc:1467] Processing CreateTablet for tablet 60548b1203114b258a60bab2b69e4bd1 (DEFAULT_TABLE table=test-table [id=c5dc4ffd17b24f05852b8a02ab95dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:56:22.107551 11948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60548b1203114b258a60bab2b69e4bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:56:22.107630 12320 tablet_bootstrap.cc:654] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Neither blocks nor log segments found. Creating new log.
I20260929 22:56:22.107990 12320 log.cc:824] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:56:22.108150 12319 tablet_bootstrap.cc:654] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Neither blocks nor log segments found. Creating new log.
I20260929 22:56:22.108506 12319 log.cc:824] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Log is configured to *not* fsync() on all Append() calls
I20260929 22:56:22.108743 12320 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: No bootstrap required, opened a new log
I20260929 22:56:22.108804 12320 ts_tablet_manager.cc:1397] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:56:22.110069 12320 raft_consensus.cc:348] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.110195 12320 raft_consensus.cc:374] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:56:22.110216 12320 raft_consensus.cc:729] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efe62a171b274d4da073e5f3681914bb, State: Initialized, Role: FOLLOWER
I20260929 22:56:22.110335 12320 consensus_queue.cc:260] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.110582 12320 ts_tablet_manager.cc:1428] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:56:22.110589 12300 heartbeater.cc:503] Master 127.0.124.190:34313 was elected leader, sending a full tablet report...
I20260929 22:56:22.111343 12319 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: No bootstrap required, opened a new log
I20260929 22:56:22.111429 12319 ts_tablet_manager.cc:1397] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260929 22:56:22.112362 12324 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: Bootstrap starting.
I20260929 22:56:22.113035 12324 tablet_bootstrap.cc:654] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: Neither blocks nor log segments found. Creating new log.
I20260929 22:56:22.113458 12324 log.cc:824] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: Log is configured to *not* fsync() on all Append() calls
I20260929 22:56:22.113762 12319 raft_consensus.cc:348] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.113919 12319 raft_consensus.cc:374] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:56:22.113960 12319 raft_consensus.cc:729] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 730afc248cdb4e0d9fddb53283f3d198, State: Initialized, Role: FOLLOWER
I20260929 22:56:22.114077 12319 consensus_queue.cc:260] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.114349 12319 ts_tablet_manager.cc:1428] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:56:22.114387 12165 heartbeater.cc:503] Master 127.0.124.190:34313 was elected leader, sending a full tablet report...
I20260929 22:56:22.115000 12324 tablet_bootstrap.cc:492] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: No bootstrap required, opened a new log
I20260929 22:56:22.115063 12324 ts_tablet_manager.cc:1397] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:56:22.117328 12324 raft_consensus.cc:348] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.117470 12324 raft_consensus.cc:374] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:56:22.117512 12324 raft_consensus.cc:729] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124fd26505194ca2bcbd053dde3a8663, State: Initialized, Role: FOLLOWER
I20260929 22:56:22.117647 12324 consensus_queue.cc:260] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.117962 12026 heartbeater.cc:503] Master 127.0.124.190:34313 was elected leader, sending a full tablet report...
I20260929 22:56:22.118221 12324 ts_tablet_manager.cc:1428] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:56:22.138502 12326 raft_consensus.cc:482] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:56:22.138686 12326 raft_consensus.cc:504] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.139693 12326 leader_election.cc:288] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efe62a171b274d4da073e5f3681914bb (127.0.124.131:34165), 124fd26505194ca2bcbd053dde3a8663 (127.0.124.129:42221)
I20260929 22:56:22.143474 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.139282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:42221 (local address 127.0.124.130:33441)
0929 22:56:22.139380 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.139392 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.139436 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.139872 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.139873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.139875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:56:22.140045 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.140048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.141218 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.141219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.142317 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.142320 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.143221 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.143222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.143293 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.143296 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.143341 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.143394 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260929 22:56:22.143914 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.139617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:33441 (local address 127.0.124.129:42221)
0929 22:56:22.139659 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.139662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.139671 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:56:22.139699 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.139700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.139712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.139766 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:56:22.140125 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.140893 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.142523 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.143117 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.143184 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.143193 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.143815 (+ 622us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.143854 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:56:22.144297 11977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60548b1203114b258a60bab2b69e4bd1" candidate_uuid: "730afc248cdb4e0d9fddb53283f3d198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124fd26505194ca2bcbd053dde3a8663" is_pre_election: true
I20260929 22:56:22.144433 11977 raft_consensus.cc:2454] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 730afc248cdb4e0d9fddb53283f3d198 in term 0.
I20260929 22:56:22.144709 12054 leader_election.cc:302] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124fd26505194ca2bcbd053dde3a8663, 730afc248cdb4e0d9fddb53283f3d198; no voters:
I20260929 22:56:22.144913 12326 raft_consensus.cc:2781] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:56:22.145023 12326 raft_consensus.cc:482] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:56:22.145087 12326 raft_consensus.cc:3037] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:56:22.145957 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.139517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:38781 (local address 127.0.124.131:34165)
0929 22:56:22.139668 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.139671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.139857 (+ 186us) server_negotiation.cc:407] Connection header received
0929 22:56:22.139966 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.139967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.139986 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.140034 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:56:22.140267 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.140936 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.144879 (+ 3943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.145379 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.145424 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.145432 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.145798 (+ 366us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.145840 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260929 22:56:22.146220 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.139284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:34165 (local address 127.0.124.130:38781)
0929 22:56:22.139805 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.139815 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:56:22.139879 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:56:22.140097 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:56:22.140098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:56:22.140100 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:56:22.140167 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.140168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.142669 (+ 2501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.142670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.144778 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:56:22.144780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.145645 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.145646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:56:22.145713 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.145717 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:56:22.146086 (+ 369us) client_negotiation.cc:240] Negotiation successful
0929 22:56:22.146125 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":15,"thread_start_us":117,"threads_started":1}
I20260929 22:56:22.146205 12326 raft_consensus.cc:504] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.146520 12254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60548b1203114b258a60bab2b69e4bd1" candidate_uuid: "730afc248cdb4e0d9fddb53283f3d198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efe62a171b274d4da073e5f3681914bb" is_pre_election: true
I20260929 22:56:22.146652 12254 raft_consensus.cc:2454] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 730afc248cdb4e0d9fddb53283f3d198 in term 0.
I20260929 22:56:22.146736 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60548b1203114b258a60bab2b69e4bd1" candidate_uuid: "730afc248cdb4e0d9fddb53283f3d198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efe62a171b274d4da073e5f3681914bb"
I20260929 22:56:22.146795 12253 raft_consensus.cc:3037] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:56:22.147171 12326 leader_election.cc:288] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [CANDIDATE]: Term 1 election: Requested vote from peers efe62a171b274d4da073e5f3681914bb (127.0.124.131:34165), 124fd26505194ca2bcbd053dde3a8663 (127.0.124.129:42221)
I20260929 22:56:22.147393 11977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60548b1203114b258a60bab2b69e4bd1" candidate_uuid: "730afc248cdb4e0d9fddb53283f3d198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124fd26505194ca2bcbd053dde3a8663"
I20260929 22:56:22.147480 11977 raft_consensus.cc:3037] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:56:22.147691 12253 raft_consensus.cc:2454] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 730afc248cdb4e0d9fddb53283f3d198 in term 1.
I20260929 22:56:22.147858 12052 leader_election.cc:302] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 730afc248cdb4e0d9fddb53283f3d198, efe62a171b274d4da073e5f3681914bb; no voters:
I20260929 22:56:22.147929 12326 raft_consensus.cc:2781] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:56:22.148061 12326 raft_consensus.cc:686] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 1 LEADER]: Becoming Leader. State: Replica: 730afc248cdb4e0d9fddb53283f3d198, State: Running, Role: LEADER
I20260929 22:56:22.148141 12326 consensus_queue.cc:237] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } }
I20260929 22:56:22.148541 11977 raft_consensus.cc:2454] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 730afc248cdb4e0d9fddb53283f3d198 in term 1.
I20260929 22:56:22.148959 11816 catalog_manager.cc:5495] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 reported cstate change: term changed from 0 to 1, leader changed from <none> to 730afc248cdb4e0d9fddb53283f3d198 (127.0.124.130). New cstate: current_term: 1 leader_uuid: "730afc248cdb4e0d9fddb53283f3d198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "730afc248cdb4e0d9fddb53283f3d198" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 46703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 } health_report { overall_health: UNKNOWN } } }
I20260929 22:56:22.158622 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.156264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60374 (local address 127.0.124.130:46703)
0929 22:56:22.156297 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:56:22.156299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:56:22.156391 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:56:22.156414 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:56:22.156415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:56:22.156428 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:56:22.156507 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:56:22.156613 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.157057 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.157871 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:56:22.158075 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:56:22.158143 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:56:22.158307 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:56:22.158405 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:56:22.158507 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 22:56:22.158526 (+ 19us) server_negotiation.cc:299] Negotiation successful
0929 22:56:22.158544 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:56:22.160140 11977 raft_consensus.cc:1261] T 60548b1203114b258a60bab2b69e4bd1 P 124fd26505194ca2bcbd053dde3a8663 [term 1 FOLLOWER]: Refusing update from remote peer 730afc248cdb4e0d9fddb53283f3d198: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:56:22.160235 12253 raft_consensus.cc:1261] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 1 FOLLOWER]: Refusing update from remote peer 730afc248cdb4e0d9fddb53283f3d198: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:56:22.160552 12329 consensus_queue.cc:1035] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "124fd26505194ca2bcbd053dde3a8663" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 42221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:56:22.160705 12326 consensus_queue.cc:1035] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efe62a171b274d4da073e5f3681914bb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:56:22.164017 12332 mvcc.cc:205] Tried to move back new op lower bound from 7334799696525647872 to 7334799696479473664. Current Snapshot: MvccSnapshot[applied={T|T < 7334799696525647872}]
I20260929 22:56:22.165036 12334 mvcc.cc:205] Tried to move back new op lower bound from 7334799696525647872 to 7334799696479473664. Current Snapshot: MvccSnapshot[applied={T|T < 7334799696525647872 or (T in {7334799696525647872})}]
I20260929 22:56:22.166648 11816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:56:22.166730 11816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:56:22.167470 11816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c89caf6c9f14f0eadb67046f545898d: Sending DeleteTablet for 3 replicas of tablet 60548b1203114b258a60bab2b69e4bd1
I20260929 22:56:22.167951 12099 tablet_service.cc:1514] Processing DeleteTablet for tablet 60548b1203114b258a60bab2b69e4bd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:56:22 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60368
I20260929 22:56:22.168123 11948 tablet_service.cc:1514] Processing DeleteTablet for tablet 60548b1203114b258a60bab2b69e4bd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:56:22 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:48120
I20260929 22:56:22.168490 12234 tablet_service.cc:1514] Processing DeleteTablet for tablet 60548b1203114b258a60bab2b69e4bd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:56:22 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:44030
I20260929 22:56:22.168546 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 11897
I20260929 22:56:22.169425 12340 tablet_replica.cc:330] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: stopping tablet replica
I20260929 22:56:22.169579 12340 raft_consensus.cc:2229] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:56:22.169780 12340 raft_consensus.cc:2258] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:56:22.171247 12340 ts_tablet_manager.cc:1905] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:56:22.173128 12333 mvcc.cc:205] Tried to move back new op lower bound from 7334799696525647872 to 7334799696479473664. Current Snapshot: MvccSnapshot[applied={T|T < 7334799696525647872}]
I20260929 22:56:22.174337 12340 ts_tablet_manager.cc:1918] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:56:22.174476 12340 log.cc:1196] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/60548b1203114b258a60bab2b69e4bd1
I20260929 22:56:22.174827 12340 ts_tablet_manager.cc:1939] T 60548b1203114b258a60bab2b69e4bd1 P 730afc248cdb4e0d9fddb53283f3d198: Deleting consensus metadata
I20260929 22:56:22.175271 11802 catalog_manager.cc:4841] TS 730afc248cdb4e0d9fddb53283f3d198 (127.0.124.130:46703): tablet 60548b1203114b258a60bab2b69e4bd1 (table test-table [id=c5dc4ffd17b24f05852b8a02ab95dc76]) successfully deleted
W20260929 22:56:22.176326 11802 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:42221 (error 108)
I20260929 22:56:22.176791 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.176674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:42221 (local address 127.0.0.1:48126)
0929 22:56:22.176725 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.176757 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:42221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:56:22.176882 11802 catalog_manager.cc:4584] TS 124fd26505194ca2bcbd053dde3a8663 (127.0.124.129:42221): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 60548b1203114b258a60bab2b69e4bd1: Network error: Client connection negotiation failed: client connection to 127.0.124.129:42221: connect: Connection refused (error 111)
I20260929 22:56:22.177181 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 12034
I20260929 22:56:22.182298 12342 tablet_replica.cc:330] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: stopping tablet replica
I20260929 22:56:22.182415 12342 raft_consensus.cc:2229] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:56:22.182543 12342 raft_consensus.cc:2258] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:56:22.183187 12342 ts_tablet_manager.cc:1905] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:56:22.184655 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 12171
I20260929 22:56:22.184661 12342 ts_tablet_manager.cc:1918] T 60548b1203114b258a60bab2b69e4bd1 P efe62a171b274d4da073e5f3681914bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:56:22.191800 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:56:22.191628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:34165 (local address 127.0.0.1:44042)
0929 22:56:22.191697 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:56:22.191751 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.131:34165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260929 22:56:22.191927 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 11784
I20260929 22:56:22.196290 498 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 22:56:22.541145 498 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 22:56:22.541249 498 mini_ranger.cc:66] Stopping Ranger...
I20260929 22:56:22.886622 498 mini_ranger.cc:68] Stopped Ranger
2026-09-29 22:56:22.886 UTC [11370] LOG: received smart shutdown request
2026-09-29 22:56:22.890 UTC [11370] LOG: background worker "logical replication launcher" (PID 11379) exited with exit code 1
2026-09-29 22:56:22.890 UTC [11374] LOG: shutting down
2026-09-29 22:56:23.039 UTC [11370] LOG: database system is shut down
2026-09-29T22:56:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45406 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:56:23 dist-test-slave-512q krb5kdc[12353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:56:23 dist-test-slave-512q krb5kdc[12353](info): set up 2 sockets
Sep 29 22:56:23 dist-test-slave-512q krb5kdc[12353](info): commencing operation
krb5kdc: starting...
W20260929 22:56:24.178463 498 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:56:24 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:56:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:56:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangeradmin_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangeradmin_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangerlookup_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangerlookup_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
I20260929 22:56:24.328543 498 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZ2hK39/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/postgres -l logfile start
2026-09-29 22:56:26.623 UTC [12383] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 22:56:26.623 UTC [12383] LOG: listening on IPv4 address "127.0.124.148", port 56081
2026-09-29 22:56:26.626 UTC [12383] LOG: listening on Unix socket "/tmp/.s.PGSQL.56081"
2026-09-29 22:56:26.647 UTC [12386] LOG: database system was shut down at 2026-09-29 22:56:25 UTC
2026-09-29 22:56:26.651 UTC [12383] LOG: database system is ready to accept connections
I20260929 22:56:27.610314 498 mini_postgres.cc:96] Postgres bound to 56081
2026-09-29 22:56:27.616 UTC [12394] FATAL: database "slave" does not exist
127.0.124.148:56081 - accepting connections
I20260929 22:56:27.616976 498 mini_ranger.cc:161] Starting Ranger...
I20260929 22:56:27.630970 498 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 22:56:28.053681 498 mini_ranger.cc:87] Created ranger Postgres database
I20260929 22:56:28.053746 498 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin
2026-09-29 22:56:28,328 [I] DB FLAVOR :POSTGRES
2026-09-29 22:56:28,329 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:56:28,329 [I] Checking connection..
2026-09-29 22:56:28,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 22:56:28,572 [I] Checking connection passed.
2026-09-29 22:56:28,573 [I] --------- Verifying version history table ---------
2026-09-29 22:56:28,573 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:56:28,837 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:56:28,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:56:29,059 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:56:29,060 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 22:56:29,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 22:56:29.291 UTC [12458] WARNING: there is no transaction in progress
2026-09-29 22:56:29,296 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 22:56:29,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:56:29,532 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 22:56:29,532 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:56:29,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 22:56:29,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 22:56:30,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-512q.c.gcp-upstream.internal','N') ;"
2026-09-29 22:56:30,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:56:30,491 [I] Table x_portal_user does not exist in database ranger
2026-09-29 22:56:30,492 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:56:30,727 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 22:56:30,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:56:30,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:56:31,237 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 22:56:31,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 22:56:32.139 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.154 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.168 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.181 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.199 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.218 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.280 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.287 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.300 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.310 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.319 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.331 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.340 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.347 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.354 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32.361 UTC [12566] WARNING: there is no transaction in progress
2026-09-29 22:56:32,945 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 22:56:32,946 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 22:56:33,173 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 22:56:33,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:56:33,437 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 22:56:33,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:56:33,697 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 22:56:33,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:56:33,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:56:34,224 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-512q.c.gcp-upstream.internal';"
2026-09-29 22:56:34,473 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 22:56:34,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 22:56:34,726 [I] DB_PATCHES have already been applied
I20260929 22:56:34.732036 498 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZ2hK39/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 22:56:34.732091 498 mini_ranger.cc:193] Using host: 127.0.124.148
I20260929 22:56:34.735116 498 mini_ranger.cc:227] Ranger admin URL: http://127.0.124.148:34237
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 10:56:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 22:56:35.831763 498 mini_ranger.cc:160] Time spent starting Ranger: real 8.215s user 0.001s sys 0.007s
Sep 29, 2026 10:56:55 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 10:56:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 29, 2026 10:56:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 10:56:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 10:56:56 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 22:56:57.316649 498 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.124.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.124.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangerkms_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.124.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/rangerkms_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.124.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.124.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.124.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/HTTP_127.0.124.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 22:56:57 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722617, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 22:56:57.420393 498 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 22:56:57.429442 498 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 22:56:58.220367 498 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 22:56:58.220446 498 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms
I20260929 22:56:58.220463 498 mini_ranger_kms.cc:227] Using postgres at 127.0.124.148:56081
2026-09-29 22:56:58,414 [I] DB FLAVOR :POSTGRES
2026-09-29 22:56:58,414 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:56:58,414 [I] Checking connection
2026-09-29 22:56:58,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 22:56:58,661 [I] connection success
2026-09-29 22:56:58,661 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 22:56:58,661 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 22:56:58,661 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 22:56:58,885 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 22:56:58,885 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:56:58,886 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 22:56:58,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.124.148:56081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 22:56:59,144 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 22:56:59.580943 498 mini_ranger_kms.cc:310] Created kms service
I20260929 22:56:59.779743 498 mini_ranger_kms.cc:326] Created kudu user
I20260929 22:56:59.826495 498 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 22:56:59 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722617, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:00.220970 498 mini_ranger_kms.cc:384] Added ranger policy
I20260929 22:57:00.221181 498 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZ2hK39/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZ2hK39/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 22:57:00.221206 498 mini_ranger_kms.cc:240] Using host: 127.0.124.148
I20260929 22:57:00.224443 498 mini_ranger_kms.cc:276] Ranger KMS PID: 12746
I20260929 22:57:00.224524 498 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.124.148:43621
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 10:57:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 22:57:02.541460 498 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.121s user 0.000s sys 0.175s
I20260929 22:57:02.541559 498 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 22:57:02.541615 498 mini_ranger_kms.cc:401] 127.0.124.148:43621/kms/v1/keys
Sep 29 22:57:02 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722622, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 22:57:03 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722622, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
Sep 29 22:57:03 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722622, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.124.148@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
Sep 29 22:57:05 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:57:05.598762 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41421
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:41421
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:05.676837 12797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:05.677032 12797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:05.677054 12797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:05.678174 12797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:05.678212 12797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:05.678226 12797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:05.678238 12797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:05.678251 12797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:05.679924 12797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.124.148:43621/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:41421
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:05.680159 12797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:05.680392 12797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:05.686309 12805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:05.686430 12803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:05.686329 12802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:05.686568 12797 server_base.cc:1034] running on GCE node
I20260929 22:57:05.686985 12797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:05.687263 12797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:05.688416 12797 hybrid_clock.cc:648] HybridClock initialized: now 1790722625688381 us; error 51 us; skew 500 ppm
Sep 29 22:57:05 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722625, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:05.690933 12797 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:05.691394 12797 webserver.cc:460] Webserver started at http://127.0.124.190:37991/ using document root <none> and password file <none>
I20260929 22:57:05.691630 12797 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:05.691691 12797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:05.691828 12797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:57:05 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722625, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:05.748761 12797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "f7d2399d47ec4ffbaeeb131899e727be"
format_stamp: "Formatted at 2026-09-29 22:57:05 on dist-test-slave-512q"
server_key: "37db44ad744a4495115fa59ffe532430"
server_key_iv: "6967587eb4b73ea6ea616bbe16e04ba8"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:05.749148 12797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "f7d2399d47ec4ffbaeeb131899e727be"
format_stamp: "Formatted at 2026-09-29 22:57:05 on dist-test-slave-512q"
server_key: "37db44ad744a4495115fa59ffe532430"
server_key_iv: "6967587eb4b73ea6ea616bbe16e04ba8"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:05.750590 12797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:05.761368 12812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:05.761572 12797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:57:05.761685 12797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "f7d2399d47ec4ffbaeeb131899e727be"
format_stamp: "Formatted at 2026-09-29 22:57:05 on dist-test-slave-512q"
server_key: "37db44ad744a4495115fa59ffe532430"
server_key_iv: "6967587eb4b73ea6ea616bbe16e04ba8"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:05.761765 12797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:05.775502 12797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:05.777380 12797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:05.777539 12797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:05.782140 12797 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:41421
I20260929 22:57:05.782218 12864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:41421 every 8 connection(s)
I20260929 22:57:05.782558 12797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:05.783311 12865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:05.783728 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 12797
I20260929 22:57:05.783839 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:57:05.784013 498 external_mini_cluster.cc:1428] Setting key 1df16e875e606ebf3b758fb5d4790e1a
I20260929 22:57:05.786341 12865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Bootstrap starting.
I20260929 22:57:05.787010 12865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:05.787307 12865 log.cc:824] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:05.788048 12865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: No bootstrap required, opened a new log
Sep 29 22:57:05 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:05.790442 12865 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:05.790606 12865 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:05.790688 12865 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d2399d47ec4ffbaeeb131899e727be, State: Initialized, Role: FOLLOWER
I20260929 22:57:05.790817 12865 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:05.790886 12865 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:05.790915 12865 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:05.790979 12865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:05.791608 12865 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:05.791713 12865 leader_election.cc:302] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7d2399d47ec4ffbaeeb131899e727be; no voters:
I20260929 22:57:05.791896 12865 leader_election.cc:288] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:57:05.792119 12865 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:05.792174 12870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:05.792392 12870 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 LEADER]: Becoming Leader. State: Replica: f7d2399d47ec4ffbaeeb131899e727be, State: Running, Role: LEADER
I20260929 22:57:05.792559 12870 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:05.792943 12870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7d2399d47ec4ffbaeeb131899e727be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } } }
I20260929 22:57:05.793079 12870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:05.793263 12870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7d2399d47ec4ffbaeeb131899e727be. Latest consensus state: current_term: 1 leader_uuid: "f7d2399d47ec4ffbaeeb131899e727be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } } }
I20260929 22:57:05.793380 12870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:05.793550 12882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:05.793588 12865 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:57:05.794041 12882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:05.796777 12868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:05.784591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.0.124.190:41421)
0929 22:57:05.784789 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:05.784797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:05.784819 (+ 22us) server_negotiation.cc:407] Connection header received
0929 22:57:05.785229 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:05.785235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:05.785279 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:05.785430 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:05.786051 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:05.787008 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:05.788055 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:05.788587 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:05.788706 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:05.791045 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:05.791049 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:05.791049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:05.791061 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:05.793064 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:05.793463 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:05.793466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:05.793466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:05.793561 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:05.793766 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:05.793767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:05.793767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:05.794068 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:05.794203 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:05.794671 (+ 468us) server_negotiation.cc:299] Negotiation successful
0929 22:57:05.794790 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":62,"threads_started":1}
I20260929 22:57:05.799348 12882 catalog_manager.cc:1347] Generated new cluster ID: 8fe16eddf5404d6dae2b59fb7d1d7151
I20260929 22:57:05.799397 12882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:05.815124 12882 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:57:05.815902 12882 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:05.825965 12882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Generated new TSK 0
I20260929 22:57:05.826217 12882 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:57:06.518980 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:06.607820 12910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:06.608052 12910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:06.608091 12910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:06.609333 12910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:06.609400 12910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:06.609442 12910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:06.610927 12910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:06.611191 12910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:06.611419 12910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:06.617211 12915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:06.617327 12918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:06.617221 12916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:06.618419 12910 server_base.cc:1034] running on GCE node
I20260929 22:57:06.618613 12910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:06.618875 12910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:06.620039 12910 hybrid_clock.cc:648] HybridClock initialized: now 1790722626620010 us; error 44 us; skew 500 ppm
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:06.623023 12910 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:06.623482 12910 webserver.cc:460] Webserver started at http://127.0.124.129:43801/ using document root <none> and password file <none>
I20260929 22:57:06.623735 12910 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:06.623804 12910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:06.623958 12910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:06.637132 12910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "00981c5513c249d8a13d7f594777315f"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "182551f67dffaa2d7b11ca298dc7e71a"
server_key_iv: "c251496521e5b5c0f560eeaa240022ed"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.637658 12910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "00981c5513c249d8a13d7f594777315f"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "182551f67dffaa2d7b11ca298dc7e71a"
server_key_iv: "c251496521e5b5c0f560eeaa240022ed"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.640961 12910 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260929 22:57:06.654644 12925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:06.654855 12910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:06.654960 12910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "00981c5513c249d8a13d7f594777315f"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "182551f67dffaa2d7b11ca298dc7e71a"
server_key_iv: "c251496521e5b5c0f560eeaa240022ed"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.655072 12910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:06.663576 12910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:06.666067 12910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:06.666251 12910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:06.666512 12910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:06.666884 12910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:06.666991 12910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:06.667095 12910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:06.667168 12910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:06.674044 12910 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45543
I20260929 22:57:06.674299 13038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45543 every 8 connection(s)
I20260929 22:57:06.674610 12910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:06.676546 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 12910
I20260929 22:57:06.676643 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:57:06.676811 498 external_mini_cluster.cc:1428] Setting key 320f7bdc57d58007513be003a7edcd30
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:06.695386 13041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:06.675410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.129:36613)
0929 22:57:06.675681 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:06.675741 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:06.676495 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:06.682905 (+ 6410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:06.682912 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:06.683182 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:06.683473 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:06.683479 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.684549 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.684550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:06.685833 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:06.685836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.686381 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.686382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:06.686546 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:06.687251 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:06.687261 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:06.691100 (+ 3839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:06.693482 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:06.693490 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:06.693493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:06.693878 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:06.694105 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:06.694106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:06.694106 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:06.694250 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:06.694579 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:06.694585 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:06.694785 (+ 200us) client_negotiation.cc:769] Sending connection context
0929 22:57:06.694910 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 22:57:06.695109 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":78,"threads_started":1}
I20260929 22:57:06.695940 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:06.675422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:36613 (local address 127.0.124.190:41421)
0929 22:57:06.682595 (+ 7173us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:06.682597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:06.682608 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:57:06.682637 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:06.682638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:06.682651 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:06.682735 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:06.683608 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.684423 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.685937 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.686226 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.686293 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:06.691231 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:06.691233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:06.691234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:06.691242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:06.693380 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:06.693973 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:06.693974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:06.693975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:06.694040 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:06.694317 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:06.694317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:06.694318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:06.694484 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:06.694541 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:06.695749 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0929 22:57:06.695842 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7137,"thread_start_us":101,"threads_started":1}
I20260929 22:57:06.696854 13039 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:06.696966 13039 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:06.697163 13039 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:06.697745 12829 ts_manager.cc:194] Registered new tserver with Master: 00981c5513c249d8a13d7f594777315f (127.0.124.129:45543)
I20260929 22:57:06.698618 12829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:36613
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:57:06.711097 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:06.811777 13047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:06.812119 13047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:06.812194 13047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:06.814169 13047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:06.814271 13047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:06.814337 13047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:06.816505 13047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:06.816891 13047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:06.817195 13047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:06.823894 13055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:06.824249 13054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:06.824451 13057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:06.825338 13047 server_base.cc:1034] running on GCE node
I20260929 22:57:06.825699 13047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:06.826006 13047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:06.827162 13047 hybrid_clock.cc:648] HybridClock initialized: now 1790722626827138 us; error 39 us; skew 500 ppm
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:06.829908 13047 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:06.830436 13047 webserver.cc:460] Webserver started at http://127.0.124.130:42891/ using document root <none> and password file <none>
I20260929 22:57:06.830703 13047 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:06.830770 13047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:06.830909 13047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:06.848125 13047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "10ace675b7f14851a7d895a51f12cead"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "10f08289e72057fbbef8e80e185e811e"
server_key_iv: "312649130890b4de07f47559adde2892"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.848706 13047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "10ace675b7f14851a7d895a51f12cead"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "10f08289e72057fbbef8e80e185e811e"
server_key_iv: "312649130890b4de07f47559adde2892"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.850611 13047 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:06.868368 13064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:06.868604 13047 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260929 22:57:06.868691 13047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "10ace675b7f14851a7d895a51f12cead"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "10f08289e72057fbbef8e80e185e811e"
server_key_iv: "312649130890b4de07f47559adde2892"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:06.868777 13047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:06.894138 13047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:06.897061 13047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:06.897262 13047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:06.897524 13047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:06.897982 13047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:06.898072 13047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:06.898142 13047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:06.898195 13047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:06.905143 13047 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:34575
I20260929 22:57:06.905601 13047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:57:06.917078 13177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:34575 every 8 connection(s)
I20260929 22:57:06.917680 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13047
I20260929 22:57:06.917778 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:57:06.917965 498 external_mini_cluster.cc:1428] Setting key 3adaa8a3cd0a7dd194d2c2243274ab34
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Sep 29 22:57:06 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:06.943120 13180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:06.917731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.130:49433)
0929 22:57:06.920290 (+ 2559us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:06.920338 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:06.923743 (+ 3405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:06.924114 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:06.924119 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:06.924394 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:06.924680 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:06.924687 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.925726 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.925727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:06.927096 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:06.927099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.927661 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.927662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:06.927796 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:06.928431 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:06.928441 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:06.939311 (+ 10870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:06.941397 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:06.941404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:06.941407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:06.941708 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:06.941942 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:06.941943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:06.941943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:06.942112 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:06.942405 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:06.942411 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:06.942574 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 22:57:06.942674 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:57:06.942828 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2515,"thread_start_us":73,"threads_started":1}
I20260929 22:57:06.943807 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:06.917988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:49433 (local address 127.0.124.190:41421)
0929 22:57:06.918033 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:06.918036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:06.920417 (+ 2381us) server_negotiation.cc:407] Connection header received
0929 22:57:06.923874 (+ 3457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:06.923875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:06.923890 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:06.923922 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:06.924792 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.925606 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.927199 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:06.927484 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:06.927558 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:06.939430 (+ 11872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:06.939432 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:06.939433 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:06.939441 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:06.941295 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:06.941804 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:06.941805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:06.941805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:06.941861 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:06.942183 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:06.942183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:06.942184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:06.942321 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:06.942379 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:06.943622 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0929 22:57:06.943715 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:57:06.944569 13178 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:06.944674 13178 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:06.944880 13178 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:06.945266 12829 ts_manager.cc:194] Registered new tserver with Master: 10ace675b7f14851a7d895a51f12cead (127.0.124.130:34575)
I20260929 22:57:06.945776 12829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:49433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:57:06.963049 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:07.075585 13183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:07.075851 13183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:07.075887 13183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:07.077536 13183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:07.077590 13183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:07.077627 13183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:07.079640 13183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:07.079870 13183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:07.080168 13183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:07.086472 13190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.086947 13189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.087148 13192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:07.087334 13183 server_base.cc:1034] running on GCE node
I20260929 22:57:07.087550 13183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:07.087816 13183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:07.088995 13183 hybrid_clock.cc:648] HybridClock initialized: now 1790722627088969 us; error 47 us; skew 500 ppm
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:07.092324 13183 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:07.092832 13183 webserver.cc:460] Webserver started at http://127.0.124.131:38641/ using document root <none> and password file <none>
I20260929 22:57:07.093182 13183 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:07.093248 13183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:07.093377 13183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:07.113809 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "6fb7cbf182564254809556e27be1d524"
format_stamp: "Formatted at 2026-09-29 22:57:07 on dist-test-slave-512q"
server_key: "f3969adc419b3f6831d34f1b6cae47f9"
server_key_iv: "e146286790468bc4fcb70378f77db6fe"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.114293 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "6fb7cbf182564254809556e27be1d524"
format_stamp: "Formatted at 2026-09-29 22:57:07 on dist-test-slave-512q"
server_key: "f3969adc419b3f6831d34f1b6cae47f9"
server_key_iv: "e146286790468bc4fcb70378f77db6fe"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.116667 13183 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:07.145668 13199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.145870 13183 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.001s sys 0.000s
I20260929 22:57:07.145968 13183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "6fb7cbf182564254809556e27be1d524"
format_stamp: "Formatted at 2026-09-29 22:57:07 on dist-test-slave-512q"
server_key: "f3969adc419b3f6831d34f1b6cae47f9"
server_key_iv: "e146286790468bc4fcb70378f77db6fe"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.146080 13183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:07.174722 13183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:07.177101 13183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:07.177235 13183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:07.177533 13183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:07.177853 13183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:07.177894 13183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.177922 13183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:07.177942 13183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.184410 13183 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:34313
I20260929 22:57:07.184751 13312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:34313 every 8 connection(s)
I20260929 22:57:07.184863 13183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:07.190858 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13183
I20260929 22:57:07.190958 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:57:07.191152 498 external_mini_cluster.cc:1428] Setting key d9bcb0f66bb115421bf9653146846dd3
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:07.197793 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.187053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:50659 (local address 127.0.124.190:41421)
0929 22:57:07.187107 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:07.187110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:07.187442 (+ 332us) server_negotiation.cc:407] Connection header received
0929 22:57:07.188076 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:07.188077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:07.188091 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:07.188164 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:07.188933 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.189769 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.191298 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.191612 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.191658 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.194360 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:07.194362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:07.194363 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:07.194370 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:07.196108 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.196663 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.196664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.196664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.196728 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.197040 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.197041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.197041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.197180 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:07.197250 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:07.197604 (+ 354us) server_negotiation.cc:299] Negotiation successful
0929 22:57:07.197695 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:57:07.198004 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.187019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.131:50659)
0929 22:57:07.187282 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:07.187330 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:07.187961 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:07.188253 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:07.188257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:07.188512 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:07.188786 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.188793 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.189884 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.189885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.191195 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.191198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.191760 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.191761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.191907 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.192562 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:07.192572 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:07.194249 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:07.196256 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.196263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.196266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.196573 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.196808 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.196809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.196809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.196950 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.197253 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:07.197259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:07.197440 (+ 181us) client_negotiation.cc:769] Sending connection context
0929 22:57:07.197553 (+ 113us) client_negotiation.cc:240] Negotiation successful
0929 22:57:07.197716 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":159,"threads_started":1}
I20260929 22:57:07.198395 13313 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:07.198496 13313 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.198684 13313 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:07.199044 12829 ts_manager.cc:194] Registered new tserver with Master: 6fb7cbf182564254809556e27be1d524 (127.0.124.131:34313)
I20260929 22:57:07.199556 12829 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:50659
I20260929 22:57:07.202770 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:07.203459 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 12910
I20260929 22:57:07.208170 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13047
I20260929 22:57:07.212702 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13183
I20260929 22:57:07.217554 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 12797
I20260929 22:57:07.222841 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41421
--webserver_interface=127.0.124.190
--webserver_port=37991
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:41421
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:07.303216 13316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:07.303421 13316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:07.303444 13316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:07.304597 13316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:07.304638 13316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:07.304652 13316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:07.304665 13316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:07.304713 13316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:07.306205 13316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:41421
--ranger_config_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:41421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=37991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:07.306445 13316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:07.306660 13316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:07.311408 13322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.311410 13324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.311510 13321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:07.311738 13316 server_base.cc:1034] running on GCE node
I20260929 22:57:07.311981 13316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:07.312333 13316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:07.313498 13316 hybrid_clock.cc:648] HybridClock initialized: now 1790722627313485 us; error 24 us; skew 500 ppm
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:07.315798 13316 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:07.316290 13316 webserver.cc:460] Webserver started at http://127.0.124.190:37991/ using document root <none> and password file <none>
I20260929 22:57:07.316507 13316 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:07.316584 13316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:07.359982 13316 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:57:07.360836 13332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.361014 13316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:57:07.361110 13316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "f7d2399d47ec4ffbaeeb131899e727be"
format_stamp: "Formatted at 2026-09-29 22:57:05 on dist-test-slave-512q"
server_key: "37db44ad744a4495115fa59ffe532430"
server_key_iv: "6967587eb4b73ea6ea616bbe16e04ba8"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.361444 13316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:07.380741 13316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:07.382313 13316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:07.382467 13316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:07.386899 13316 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:41421
I20260929 22:57:07.386936 13384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:41421 every 8 connection(s)
I20260929 22:57:07.387287 13316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:07.388224 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13316
I20260929 22:57:07.388518 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:45543
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:41421
--webserver_port=43801
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:07.388653 13385 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:57:07.389699 13385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Bootstrap starting.
I20260929 22:57:07.399771 13385 log.cc:824] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:07.402215 13385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:07.402532 13385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Bootstrap complete.
I20260929 22:57:07.405808 13385 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:07.406111 13385 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d2399d47ec4ffbaeeb131899e727be, State: Initialized, Role: FOLLOWER
I20260929 22:57:07.406262 13385 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:07.406324 13385 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:07.406360 13385 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:07.406404 13385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:57:07.407645 13385 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:07.407747 13385 leader_election.cc:302] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7d2399d47ec4ffbaeeb131899e727be; no voters:
I20260929 22:57:07.407907 13385 leader_election.cc:288] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:57:07.407992 13389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:57:07.408129 13385 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:07.408159 13389 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [term 2 LEADER]: Becoming Leader. State: Replica: f7d2399d47ec4ffbaeeb131899e727be, State: Running, Role: LEADER
I20260929 22:57:07.408288 13389 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } }
I20260929 22:57:07.408542 13389 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7d2399d47ec4ffbaeeb131899e727be. Latest consensus state: current_term: 2 leader_uuid: "f7d2399d47ec4ffbaeeb131899e727be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } } }
I20260929 22:57:07.408563 13390 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f7d2399d47ec4ffbaeeb131899e727be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2399d47ec4ffbaeeb131899e727be" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 41421 } } }
I20260929 22:57:07.408603 13389 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:07.408607 13390 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:07.408887 13393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:07.409402 13393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:07.409535 13393 catalog_manager.cc:1259] Loaded cluster ID: 8fe16eddf5404d6dae2b59fb7d1d7151
I20260929 22:57:07.409574 13393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:07.409788 13385 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:57:07.413007 13393 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:07.413683 13393 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Loaded TSK: 0
I20260929 22:57:07.414011 13393 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:57:07.508285 13387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:07.508582 13387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:07.508617 13387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:07.510335 13387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:07.510396 13387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:07.510437 13387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:07.512616 13387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:45543
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=43801
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:07.512864 13387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:07.513110 13387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:07.520753 13425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.520864 13423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.520771 13422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:07.521613 13387 server_base.cc:1034] running on GCE node
I20260929 22:57:07.521852 13387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:07.522154 13387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:07.525475 13387 hybrid_clock.cc:648] HybridClock initialized: now 1790722627525436 us; error 49 us; skew 500 ppm
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:07.528853 13387 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:07.529482 13387 webserver.cc:460] Webserver started at http://127.0.124.129:43801/ using document root <none> and password file <none>
I20260929 22:57:07.529812 13387 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:07.529953 13387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:07.557380 13387 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:07.558135 13433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.558274 13387 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:07.558358 13387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "00981c5513c249d8a13d7f594777315f"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "182551f67dffaa2d7b11ca298dc7e71a"
server_key_iv: "c251496521e5b5c0f560eeaa240022ed"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.558797 13387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:07.588449 13387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:07.590948 13387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:07.591105 13387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:07.591364 13387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:07.591765 13387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:07.591836 13387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.591867 13387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:07.591892 13387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.598527 13387 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45543
I20260929 22:57:07.598984 13387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:07.600590 13546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45543 every 8 connection(s)
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:07.608783 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13387
I20260929 22:57:07.609131 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:34575
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:41421
--webserver_port=42891
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:07.612293 13549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.599785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.129:59249)
0929 22:57:07.600121 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:07.600162 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:07.600755 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:07.601341 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:07.601346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:07.601590 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:07.601856 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.601863 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.603462 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.603464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.604819 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.604822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.605667 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.605668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.605817 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.606425 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:07.606435 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:07.608113 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:07.610371 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.610377 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.610380 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.610706 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.610994 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.610994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.610995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.611119 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.611620 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:07.611625 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:07.611772 (+ 147us) client_negotiation.cc:769] Sending connection context
0929 22:57:07.611864 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:57:07.612016 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":93,"threads_started":1}
I20260929 22:57:07.612864 13550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.599848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:59249 (local address 127.0.124.190:41421)
0929 22:57:07.600096 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:07.600107 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:07.600305 (+ 198us) server_negotiation.cc:407] Connection header received
0929 22:57:07.601018 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:07.601023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:07.601126 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:07.601269 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:07.601999 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.603357 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.604918 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.605548 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.605662 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.608328 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:07.608332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:07.608332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:07.608343 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:07.610289 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.610806 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.610810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.610810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.610921 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.611190 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.611191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.611191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.611512 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:07.611591 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:07.612477 (+ 886us) server_negotiation.cc:299] Negotiation successful
0929 22:57:07.612608 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":76,"threads_started":1}
I20260929 22:57:07.613523 13547 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:07.613620 13547 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.613840 13547 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.615048 13547 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:41421 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:57:07.615121 13547 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.615207 13547 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:07.615535 13547 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.615624 13547 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.615927 13547 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:57:07.713558 13551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:07.713817 13551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:07.713855 13551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:07.715507 13551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:07.715566 13551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:07.715605 13551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:07.717864 13551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:34575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=42891
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:07.718113 13551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:07.718362 13551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:07.724740 13557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.724736 13556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.724757 13559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:07.725303 13551 server_base.cc:1034] running on GCE node
I20260929 22:57:07.725526 13551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:07.725795 13551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:07.726980 13551 hybrid_clock.cc:648] HybridClock initialized: now 1790722627726978 us; error 39 us; skew 500 ppm
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:07.730370 13551 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:07.730962 13551 webserver.cc:460] Webserver started at http://127.0.124.130:42891/ using document root <none> and password file <none>
I20260929 22:57:07.731243 13551 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:07.731335 13551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:07.748284 13551 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260929 22:57:07.749961 13567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.750183 13551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:07.750273 13551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "10ace675b7f14851a7d895a51f12cead"
format_stamp: "Formatted at 2026-09-29 22:57:06 on dist-test-slave-512q"
server_key: "10f08289e72057fbbef8e80e185e811e"
server_key_iv: "312649130890b4de07f47559adde2892"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.750715 13551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:07.773645 13551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:07.776134 13551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:07.776324 13551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:07.776587 13551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:07.776976 13551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:07.777041 13551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.777074 13551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:07.777100 13551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.784263 13551 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:34575
I20260929 22:57:07.784332 13680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:34575 every 8 connection(s)
I20260929 22:57:07.784749 13551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:07.791884 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13551
I20260929 22:57:07.792264 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.124.148:43621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:34313
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:41421
--webserver_port=38641
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:07.794713 13550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.785520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:44765 (local address 127.0.124.190:41421)
0929 22:57:07.785578 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:07.785580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:07.785852 (+ 272us) server_negotiation.cc:407] Connection header received
0929 22:57:07.786367 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:07.786369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:07.786380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:07.786431 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:07.786977 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.787533 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.788595 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.788793 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.788879 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.791582 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:07.791583 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:07.791583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:07.791591 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:07.793146 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.793566 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.793567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.793568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.793632 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.793934 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.793935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.793936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.794089 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:07.794133 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:07.794513 (+ 380us) server_negotiation.cc:299] Negotiation successful
0929 22:57:07.794611 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:57:07.795213 13683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.785485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.130:44765)
0929 22:57:07.785737 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:07.785768 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:07.786265 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:07.786506 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:07.786509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:07.786694 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:07.786881 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.786885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.787627 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.787628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.788504 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.788507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.788904 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.788905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.789022 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.789668 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:07.789678 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:07.791477 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:07.793236 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.793243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.793246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.793467 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.793715 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.793716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.793717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.793859 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.794184 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:07.794190 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:07.794367 (+ 177us) client_negotiation.cc:769] Sending connection context
0929 22:57:07.794834 (+ 467us) client_negotiation.cc:240] Negotiation successful
0929 22:57:07.795011 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":91,"threads_started":1}
I20260929 22:57:07.795759 13681 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:07.795861 13681 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.796085 13681 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.796872 13681 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:41421 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:57:07.796950 13681 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.797020 13681 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:07.797401 13681 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.797479 13681 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.797796 13681 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:57:07.895645 13684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:07.895830 13684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:07.895853 13684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:07.897045 13684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:07.897087 13684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:07.897140 13684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:07.899290 13684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.124.148:43621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:34313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=38641
--tserver_master_addrs=127.0.124.190:41421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:07.899523 13684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:07.899780 13684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:07.909017 13693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.909003 13690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:07.908987 13691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:07.910414 13684 server_base.cc:1034] running on GCE node
I20260929 22:57:07.910625 13684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:07.910894 13684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:07.912050 13684 hybrid_clock.cc:648] HybridClock initialized: now 1790722627912036 us; error 26 us; skew 500 ppm
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:07.914693 13684 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:07.915179 13684 webserver.cc:460] Webserver started at http://127.0.124.131:38641/ using document root <none> and password file <none>
I20260929 22:57:07.915426 13684 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:07.915506 13684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:07.930846 13684 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:07.931602 13701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.931828 13684 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:07.931911 13684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "6fb7cbf182564254809556e27be1d524"
format_stamp: "Formatted at 2026-09-29 22:57:07 on dist-test-slave-512q"
server_key: "f3969adc419b3f6831d34f1b6cae47f9"
server_key_iv: "e146286790468bc4fcb70378f77db6fe"
server_key_version: "kuduclusterkey@0"
I20260929 22:57:07.932363 13684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:07.947726 13684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:07.949862 13684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:07.950012 13684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:07.950281 13684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:07.950646 13684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:07.950699 13684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.950742 13684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:07.950768 13684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:07.957067 13684 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:34313
I20260929 22:57:07.957144 13814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:34313 every 8 connection(s)
I20260929 22:57:07.957442 13684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:07.962314 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13684
Sep 29 22:57:07 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:07.974608 13550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.958133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44667 (local address 127.0.124.190:41421)
0929 22:57:07.958205 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:07.958208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:07.958412 (+ 204us) server_negotiation.cc:407] Connection header received
0929 22:57:07.958886 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:07.958888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:07.958901 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:07.958980 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:07.959581 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.960400 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.961379 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.961660 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.961744 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.964187 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:07.964191 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:07.964191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:07.964203 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:07.972932 (+ 8729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.973502 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.973504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.973504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.973569 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.973890 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.973891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.973892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.974025 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:07.974106 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:07.974440 (+ 334us) server_negotiation.cc:299] Negotiation successful
0929 22:57:07.974521 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:57:07.974875 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.958103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:41421 (local address 127.0.124.131:44667)
0929 22:57:07.958278 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:07.958318 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:07.958779 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:07.959074 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:07.959079 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:07.959291 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:07.959476 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.959480 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.960493 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.960494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.961288 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:07.961289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.961761 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.961762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:07.961867 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.962387 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:07.962400 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:07.964085 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:07.973040 (+ 8955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.973050 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.973053 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.973410 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.973651 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:07.973652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:07.973653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:07.973809 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:07.974099 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:07.974106 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:07.974251 (+ 145us) client_negotiation.cc:769] Sending connection context
0929 22:57:07.974415 (+ 164us) client_negotiation.cc:240] Negotiation successful
0929 22:57:07.974603 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260929 22:57:07.975426 13815 heartbeater.cc:347] Connected to a master server at 127.0.124.190:41421
I20260929 22:57:07.975536 13815 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.975731 13815 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.976465 13815 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:41421 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:57:07.976549 13815 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.976621 13815 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:07.977169 13815 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:07.977250 13815 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
W20260929 22:57:07.977522 13815 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:57:07.978866 13818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:07.962734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.0.124.190:41421)
0929 22:57:07.962851 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:07.962853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:07.962965 (+ 112us) server_negotiation.cc:407] Connection header received
0929 22:57:07.963030 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:07.963031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:07.963043 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:07.963108 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:07.964069 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.964808 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.973915 (+ 9107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:07.974258 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:07.974332 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:07.975910 (+ 1578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:07.975911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:07.975912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:07.975919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:07.977708 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.978095 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.978096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.978097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.978150 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:07.978351 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:07.978352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:07.978352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:07.978455 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:07.978633 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:07.978669 (+ 36us) server_negotiation.cc:299] Negotiation successful
0929 22:57:07.978752 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
Sep 29 22:57:08 dist-test-slave-512q krb5kdc[12353](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722628, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:08.616111 13547 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:08.616290 13547 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:08.616663 13349 ts_manager.cc:194] Registered new tserver with Master: 00981c5513c249d8a13d7f594777315f (127.0.124.129:45543)
I20260929 22:57:08.617659 13349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:59249
I20260929 22:57:08.797967 13681 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:08.798111 13681 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:08.798377 13349 ts_manager.cc:194] Registered new tserver with Master: 10ace675b7f14851a7d895a51f12cead (127.0.124.130:34575)
I20260929 22:57:08.798923 13349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:44765
Sep 29 22:57:08 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722628, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:08.977756 13815 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:08.977926 13815 heartbeater.cc:511] Master 127.0.124.190:41421 requested a full tablet report, sending...
I20260929 22:57:08.978260 13349 ts_manager.cc:194] Registered new tserver with Master: 6fb7cbf182564254809556e27be1d524 (127.0.124.131:34313)
I20260929 22:57:08.978786 13349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:44667
I20260929 22:57:08.984931 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:08.993847 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:08.985832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39646 (local address 127.0.124.190:41421)
0929 22:57:08.985942 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:08.985944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:08.986081 (+ 137us) server_negotiation.cc:407] Connection header received
0929 22:57:08.986135 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:08.986136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:08.986149 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:08.986225 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:08.986930 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:08.987734 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:08.988834 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:08.989148 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:08.989220 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:08.990767 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:08.990769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:08.990769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:08.990776 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:08.992627 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:08.993015 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:08.993016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:08.993017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:08.993075 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:08.993290 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:08.993290 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:08.993291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:08.993435 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:08.993526 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:08.993675 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 22:57:08.993754 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":60,"threads_started":1}
I20260929 22:57:08.996251 13349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:57:08.998441 13349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:57:09.012074 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.006629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:34313 (local address 127.0.0.1:55814)
0929 22:57:09.007623 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.007632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:09.007673 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:09.007951 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:09.007954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:09.007956 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:09.008046 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.008047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.009385 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.009386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.010640 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.010643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.011712 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.011713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.011818 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.011835 (+ 17us) client_negotiation.cc:769] Sending connection context
0929 22:57:09.011910 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:57:09.011970 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"thread_start_us":56,"threads_started":1}
I20260929 22:57:09.012688 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.006979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55814 (local address 127.0.124.131:34313)
0929 22:57:09.007516 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.007522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.007748 (+ 226us) server_negotiation.cc:407] Connection header received
0929 22:57:09.007783 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.007785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.007801 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.007859 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:09.008116 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.009301 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.010739 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.011515 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.011598 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.011674 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.012566 (+ 892us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.012614 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":47,"threads_started":1}
I20260929 22:57:09.013692 13749 tablet_service.cc:1467] Processing CreateTablet for tablet 83e44b1c98da483fae903712e80538e0 (DEFAULT_TABLE table=test-table [id=d58dccc9e51f4cf7b13702f54ba97919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:09.014096 13749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e44b1c98da483fae903712e80538e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:09.018249 13848 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Bootstrap starting.
I20260929 22:57:09.018963 13848 tablet_bootstrap.cc:654] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:09.019590 13848 log.cc:824] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:09.020394 13848 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: No bootstrap required, opened a new log
I20260929 22:57:09.020468 13848 ts_tablet_manager.cc:1397] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:09.022862 13848 raft_consensus.cc:348] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.023016 13848 raft_consensus.cc:374] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:09.023044 13848 raft_consensus.cc:729] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fb7cbf182564254809556e27be1d524, State: Initialized, Role: FOLLOWER
I20260929 22:57:09.023576 13848 consensus_queue.cc:260] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.023924 13848 ts_tablet_manager.cc:1428] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:57:09.024071 13815 heartbeater.cc:503] Master 127.0.124.190:41421 was elected leader, sending a full tablet report...
I20260929 22:57:09.028352 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.007094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.0.124.130:34575)
0929 22:57:09.007580 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.007583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.012351 (+ 4768us) server_negotiation.cc:407] Connection header received
0929 22:57:09.012473 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.012475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.012493 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.012549 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:09.012794 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.019409 (+ 6615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.026740 (+ 7331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.027740 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.027837 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.027928 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.028169 (+ 241us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.028241 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":53,"threads_started":1}
I20260929 22:57:09.028649 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.006760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:34575 (local address 127.0.0.1:40786)
0929 22:57:09.012269 (+ 5509us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.012282 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:09.012381 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:09.012655 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:09.012657 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:09.012659 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:09.012704 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.012706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.019525 (+ 6819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.019525 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.020950 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.020953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.027978 (+ 7025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.027979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.028067 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.028074 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 22:57:09.028476 (+ 402us) client_negotiation.cc:240] Negotiation successful
0929 22:57:09.028541 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5491,"thread_start_us":56,"threads_started":1}
I20260929 22:57:09.029415 13599 tablet_service.cc:1467] Processing CreateTablet for tablet 83e44b1c98da483fae903712e80538e0 (DEFAULT_TABLE table=test-table [id=d58dccc9e51f4cf7b13702f54ba97919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:09.029778 13599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e44b1c98da483fae903712e80538e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:09.031212 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.006383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45543 (local address 127.0.0.1:48514)
0929 22:57:09.007270 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.007307 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:09.007372 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:09.026992 (+ 19620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:09.026994 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:09.026997 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:09.027044 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.027045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.028916 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.028917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.030004 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.030008 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.031018 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.031020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.031081 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.031085 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:09.031114 (+ 29us) client_negotiation.cc:240] Negotiation successful
0929 22:57:09.031150 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"thread_start_us":92,"threads_started":1}
I20260929 22:57:09.031738 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.006470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.0.124.129:45543)
0929 22:57:09.026808 (+ 20338us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.026813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.026825 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:57:09.026858 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.026860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.026877 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.027213 (+ 336us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:09.027308 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.028825 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.030200 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.030916 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.031517 (+ 601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.031593 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.031618 (+ 25us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.031658 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20298,"thread_start_us":47,"threads_started":1}
I20260929 22:57:09.032470 13472 tablet_service.cc:1467] Processing CreateTablet for tablet 83e44b1c98da483fae903712e80538e0 (DEFAULT_TABLE table=test-table [id=d58dccc9e51f4cf7b13702f54ba97919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:09.032835 13472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e44b1c98da483fae903712e80538e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:09.034061 13851 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Bootstrap starting.
I20260929 22:57:09.034785 13851 tablet_bootstrap.cc:654] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:09.035140 13851 log.cc:824] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:09.035953 13851 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: No bootstrap required, opened a new log
I20260929 22:57:09.036027 13851 ts_tablet_manager.cc:1397] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:09.038832 13851 raft_consensus.cc:348] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.039036 13851 raft_consensus.cc:374] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:09.039073 13851 raft_consensus.cc:729] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ace675b7f14851a7d895a51f12cead, State: Initialized, Role: FOLLOWER
I20260929 22:57:09.039271 13851 consensus_queue.cc:260] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.039546 13851 ts_tablet_manager.cc:1428] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:57:09.039666 13681 heartbeater.cc:503] Master 127.0.124.190:41421 was elected leader, sending a full tablet report...
I20260929 22:57:09.040819 13853 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Bootstrap starting.
I20260929 22:57:09.041561 13853 tablet_bootstrap.cc:654] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:09.041894 13853 log.cc:824] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:09.042649 13853 tablet_bootstrap.cc:492] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: No bootstrap required, opened a new log
I20260929 22:57:09.042722 13853 ts_tablet_manager.cc:1397] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:09.045979 13853 raft_consensus.cc:348] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.046172 13853 raft_consensus.cc:374] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:09.046217 13853 raft_consensus.cc:729] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00981c5513c249d8a13d7f594777315f, State: Initialized, Role: FOLLOWER
I20260929 22:57:09.046367 13853 consensus_queue.cc:260] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.046638 13853 ts_tablet_manager.cc:1428] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260929 22:57:09.046754 13547 heartbeater.cc:503] Master 127.0.124.190:41421 was elected leader, sending a full tablet report...
W20260929 22:57:09.102543 13548 tablet.cc:2369] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:09.116466 13856 raft_consensus.cc:482] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:09.116596 13856 raft_consensus.cc:504] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.117014 13856 leader_election.cc:288] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fb7cbf182564254809556e27be1d524 (127.0.124.131:34313), 10ace675b7f14851a7d895a51f12cead (127.0.124.130:34575)
I20260929 22:57:09.120996 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.117306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:32989 (local address 127.0.124.131:34313)
0929 22:57:09.117353 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.117355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.117502 (+ 147us) server_negotiation.cc:407] Connection header received
0929 22:57:09.117599 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.117600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.117608 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.117634 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:09.117853 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.118555 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.119911 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.120596 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.120669 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.120678 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.120871 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.120915 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:57:09.121426 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.117177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:34313 (local address 127.0.124.129:32989)
0929 22:57:09.117439 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.117449 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:09.117528 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:09.117698 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:09.117698 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:09.117700 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:09.117790 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.117791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.118651 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.118651 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.119802 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.119805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.120711 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.120712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.120784 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.120789 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:57:09.121297 (+ 508us) client_negotiation.cc:240] Negotiation successful
0929 22:57:09.121339 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":126,"threads_started":1}
Sep 29 22:57:09 dist-test-slave-512q krb5kdc[12353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722628, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for HTTP/127.0.124.148@KRBTEST.COM
I20260929 22:57:09.121933 13754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e44b1c98da483fae903712e80538e0" candidate_uuid: "00981c5513c249d8a13d7f594777315f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fb7cbf182564254809556e27be1d524" is_pre_election: true
I20260929 22:57:09.122076 13754 raft_consensus.cc:2454] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00981c5513c249d8a13d7f594777315f in term 0.
I20260929 22:57:09.122447 13434 leader_election.cc:302] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00981c5513c249d8a13d7f594777315f, 6fb7cbf182564254809556e27be1d524; no voters:
I20260929 22:57:09.122570 13856 raft_consensus.cc:2781] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:09.122606 13856 raft_consensus.cc:482] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:09.122625 13856 raft_consensus.cc:3037] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:09.123549 13856 raft_consensus.cc:504] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.123668 13856 leader_election.cc:288] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [CANDIDATE]: Term 1 election: Requested vote from peers 6fb7cbf182564254809556e27be1d524 (127.0.124.131:34313), 10ace675b7f14851a7d895a51f12cead (127.0.124.130:34575)
I20260929 22:57:09.123988 13754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e44b1c98da483fae903712e80538e0" candidate_uuid: "00981c5513c249d8a13d7f594777315f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fb7cbf182564254809556e27be1d524"
I20260929 22:57:09.124060 13754 raft_consensus.cc:3037] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:09.124924 13754 raft_consensus.cc:2454] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00981c5513c249d8a13d7f594777315f in term 1.
I20260929 22:57:09.125134 13434 leader_election.cc:302] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00981c5513c249d8a13d7f594777315f, 6fb7cbf182564254809556e27be1d524; no voters:
I20260929 22:57:09.125252 13856 raft_consensus.cc:2781] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:09.125378 13856 raft_consensus.cc:686] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [term 1 LEADER]: Becoming Leader. State: Replica: 00981c5513c249d8a13d7f594777315f, State: Running, Role: LEADER
I20260929 22:57:09.125479 13856 consensus_queue.cc:237] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } }
I20260929 22:57:09.126291 13349 catalog_manager.cc:5495] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f reported cstate change: term changed from 0 to 1, leader changed from <none> to 00981c5513c249d8a13d7f594777315f (127.0.124.129). New cstate: current_term: 1 leader_uuid: "00981c5513c249d8a13d7f594777315f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00981c5513c249d8a13d7f594777315f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 } health_report { overall_health: UNKNOWN } } }
I20260929 22:57:09.128450 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.117730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:59393 (local address 127.0.124.130:34575)
0929 22:57:09.117768 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.117770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.119976 (+ 2206us) server_negotiation.cc:407] Connection header received
0929 22:57:09.120065 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.120067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.120075 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.120101 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:09.120304 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.120964 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.127307 (+ 6343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.127984 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.128061 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.128070 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.128295 (+ 225us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.128347 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:57:09.129031 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.117450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:34575 (local address 127.0.124.129:59393)
0929 22:57:09.119925 (+ 2475us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.119934 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:09.120001 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:09.120158 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:09.120159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:09.120160 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:09.120237 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.120239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.125667 (+ 5428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.125668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.126765 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:09.126767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.128125 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.128126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:09.128192 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.128195 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:09.128915 (+ 720us) client_negotiation.cc:240] Negotiation successful
0929 22:57:09.128955 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2459,"thread_start_us":70,"threads_started":1}
I20260929 22:57:09.129482 13635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e44b1c98da483fae903712e80538e0" candidate_uuid: "00981c5513c249d8a13d7f594777315f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ace675b7f14851a7d895a51f12cead" is_pre_election: true
I20260929 22:57:09.129490 13634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e44b1c98da483fae903712e80538e0" candidate_uuid: "00981c5513c249d8a13d7f594777315f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ace675b7f14851a7d895a51f12cead"
I20260929 22:57:09.129668 13635 raft_consensus.cc:2454] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00981c5513c249d8a13d7f594777315f in term 0.
I20260929 22:57:09.163856 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.160527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.0.124.129:45543)
0929 22:57:09.160575 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:09.160577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:09.160586 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:09.160627 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:09.160628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:09.160651 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:09.160729 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:09.160898 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.161570 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.162602 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:09.162897 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:09.162962 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:09.163286 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:09.163441 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:09.163523 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:09.163753 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 22:57:09.163776 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:57:09.169737 13634 raft_consensus.cc:3037] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:09.169937 13754 raft_consensus.cc:1261] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 1 FOLLOWER]: Refusing update from remote peer 00981c5513c249d8a13d7f594777315f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:09.170331 13860 consensus_queue.cc:1035] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fb7cbf182564254809556e27be1d524" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 34313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:09.170810 13634 raft_consensus.cc:1261] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 1 FOLLOWER]: Refusing update from remote peer 00981c5513c249d8a13d7f594777315f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:09.171054 13860 consensus_queue.cc:1035] T 83e44b1c98da483fae903712e80538e0 P 00981c5513c249d8a13d7f594777315f [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ace675b7f14851a7d895a51f12cead" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:09.174265 13864 mvcc.cc:205] Tried to move back new op lower bound from 7334799889076633600 to 7334799888898539520. Current Snapshot: MvccSnapshot[applied={T|T < 7334799889076633600}]
I20260929 22:57:09.174515 13867 mvcc.cc:205] Tried to move back new op lower bound from 7334799889076633600 to 7334799888898539520. Current Snapshot: MvccSnapshot[applied={T|T < 7334799889076633600}]
I20260929 22:57:09.182233 13865 mvcc.cc:205] Tried to move back new op lower bound from 7334799889076633600 to 7334799888898539520. Current Snapshot: MvccSnapshot[applied={T|T < 7334799889076633600}]
I20260929 22:57:09.182693 13348 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:09.182787 13348 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:09.183511 13348 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7d2399d47ec4ffbaeeb131899e727be: Sending DeleteTablet for 3 replicas of tablet 83e44b1c98da483fae903712e80538e0
I20260929 22:57:09.184001 13472 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e44b1c98da483fae903712e80538e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:09 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:48514
I20260929 22:57:09.184069 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13387
I20260929 22:57:09.184616 13749 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e44b1c98da483fae903712e80538e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:09 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:55814
I20260929 22:57:09.184792 13599 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e44b1c98da483fae903712e80538e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:09 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:40786
I20260929 22:57:09.190402 13875 tablet_replica.cc:330] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: stopping tablet replica
I20260929 22:57:09.190515 13875 raft_consensus.cc:2229] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:09.190622 13875 raft_consensus.cc:2258] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:09.190779 13874 tablet_replica.cc:330] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: stopping tablet replica
I20260929 22:57:09.190866 13874 raft_consensus.cc:2229] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:09.190953 13874 raft_consensus.cc:2258] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:09.191447 13874 ts_tablet_manager.cc:1905] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:09.193395 13875 ts_tablet_manager.cc:1905] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:09.194882 13875 ts_tablet_manager.cc:1918] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:09.194939 13875 log.cc:1196] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/83e44b1c98da483fae903712e80538e0
I20260929 22:57:09.195191 13875 ts_tablet_manager.cc:1939] T 83e44b1c98da483fae903712e80538e0 P 10ace675b7f14851a7d895a51f12cead: Deleting consensus metadata
I20260929 22:57:09.195657 13333 catalog_manager.cc:4841] TS 10ace675b7f14851a7d895a51f12cead (127.0.124.130:34575): tablet 83e44b1c98da483fae903712e80538e0 (table test-table [id=d58dccc9e51f4cf7b13702f54ba97919]) successfully deleted
W20260929 22:57:09.195816 13335 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:45543 (error 108)
I20260929 22:57:09.195947 13874 ts_tablet_manager.cc:1918] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:09.196007 13874 log.cc:1196] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/83e44b1c98da483fae903712e80538e0
I20260929 22:57:09.196316 13874 ts_tablet_manager.cc:1939] T 83e44b1c98da483fae903712e80538e0 P 6fb7cbf182564254809556e27be1d524: Deleting consensus metadata
I20260929 22:57:09.196719 13333 catalog_manager.cc:4841] TS 6fb7cbf182564254809556e27be1d524 (127.0.124.131:34313): tablet 83e44b1c98da483fae903712e80538e0 (table test-table [id=d58dccc9e51f4cf7b13702f54ba97919]) successfully deleted
I20260929 22:57:09.196763 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13551
I20260929 22:57:09.196875 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:09.196663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45543 (local address 127.0.0.1:48528)
0929 22:57:09.196811 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:09.196848 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260929 22:57:09.197768 13335 catalog_manager.cc:4584] TS 00981c5513c249d8a13d7f594777315f (127.0.124.129:45543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83e44b1c98da483fae903712e80538e0: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45543: connect: Connection refused (error 111)
I20260929 22:57:09.202241 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13684
I20260929 22:57:09.210460 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13316
I20260929 22:57:09.216336 498 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 22:57:09.560452 498 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 22:57:09.560565 498 mini_ranger.cc:66] Stopping Ranger...
I20260929 22:57:09.896744 498 mini_ranger.cc:68] Stopped Ranger
2026-09-29 22:57:09.896 UTC [12383] LOG: received smart shutdown request
2026-09-29 22:57:09.901 UTC [12383] LOG: background worker "logical replication launcher" (PID 12392) exited with exit code 1
2026-09-29 22:57:09.901 UTC [12387] LOG: shutting down
2026-09-29 22:57:10.061 UTC [12383] LOG: database system is shut down
2026-09-29T22:57:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47019 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:57:10 dist-test-slave-512q krb5kdc[13885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:57:10 dist-test-slave-512q krb5kdc[13885](info): set up 2 sockets
Sep 29 22:57:10 dist-test-slave-512q krb5kdc[13885](info): commencing operation
krb5kdc: starting...
W20260929 22:57:11.206501 498 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:57:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:57:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:57:11.318727 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36993
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:11.397373 13898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:11.397559 13898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:11.397580 13898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:11.398731 13898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:11.398772 13898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:11.398785 13898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:11.398797 13898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:11.398849 13898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:11.400311 13898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:11.400547 13898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:11.400761 13898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:11.405370 13903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:11.405395 13904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:11.405395 13906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:11.405570 13898 server_base.cc:1034] running on GCE node
I20260929 22:57:11.405864 13898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:11.406141 13898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:11.407301 13898 hybrid_clock.cc:648] HybridClock initialized: now 1790722631407296 us; error 35 us; skew 500 ppm
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:11.409696 13898 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:11.410116 13898 webserver.cc:460] Webserver started at http://127.0.124.190:39225/ using document root <none> and password file <none>
I20260929 22:57:11.410344 13898 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:11.410410 13898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:11.410557 13898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:11.411559 13898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "d20b89041eb487e50ecb74eb178b8bcd"
server_key_iv: "dcb82ab76f18f60861ce651b946d4ae0"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.411966 13898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "d20b89041eb487e50ecb74eb178b8bcd"
server_key_iv: "dcb82ab76f18f60861ce651b946d4ae0"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.413393 13898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:57:11.414146 13913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:11.414330 13898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:11.414436 13898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "d20b89041eb487e50ecb74eb178b8bcd"
server_key_iv: "dcb82ab76f18f60861ce651b946d4ae0"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.414510 13898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:11.433228 13898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:11.435292 13898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:11.435446 13898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:11.439132 13898 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:36993
I20260929 22:57:11.439170 13965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:36993 every 8 connection(s)
I20260929 22:57:11.439512 13898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:11.440448 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:11.442003 13966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.442981 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13898
I20260929 22:57:11.443094 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:57:11.443287 498 external_mini_cluster.cc:1428] Setting key f821a32e349eadcf24e15ec13da1a1e7
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.189@KRBTEST.COM; defaulting to no policy
I20260929 22:57:11.453084 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.442671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49238 (local address 127.0.124.190:36993)
0929 22:57:11.442826 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.442836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.443023 (+ 187us) server_negotiation.cc:407] Connection header received
0929 22:57:11.443764 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.443766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.443782 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.443863 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.444640 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.445969 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.446943 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.447484 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.447592 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.449748 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.449756 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.449757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.449764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.451586 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.451943 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.451945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.451945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.452023 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.452260 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.452260 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.452263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.452549 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.452614 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.452847 (+ 233us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.452934 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260929 22:57:11.453094 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.442667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36993 (local address 127.0.0.1:49238)
0929 22:57:11.442876 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.442921 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.443621 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.443901 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.443904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.444298 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.444525 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.444531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.446059 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.446060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.446835 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.446837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.447605 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.447606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.447663 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.448165 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.448173 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.449665 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.451680 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.451687 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.451688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.451870 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.452084 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.452084 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.452085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.452163 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.452644 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.452651 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.452729 (+ 78us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.452816 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.453015 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":81,"spinlock_wait_cycles":7040,"thread_start_us":106,"threads_started":1}
I20260929 22:57:11.453794 13966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.454144 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.454024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40798)
0929 22:57:11.454076 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.454121 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.189@KRBTEST.COM" created.
W20260929 22:57:11.454290 13914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
I20260929 22:57:11.454726 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.454621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40808)
0929 22:57:11.454668 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.454697 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:57:11.454873 13966 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:43693: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
I20260929 22:57:11.467049 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:43693
--webserver_interface=127.0.124.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:11.504127 13966 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } attempt: 1
I20260929 22:57:11.504664 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.504526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40822)
0929 22:57:11.504597 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.504636 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 22:57:11.504998 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.504897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40836)
0929 22:57:11.504941 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.504980 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:57:11.505080 13966 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:43693: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
W20260929 22:57:11.545087 13973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:11.545310 13973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:11.545343 13973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:11.546413 13973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:11.546480 13973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:11.546504 13973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:11.546542 13973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:11.546566 13973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:11.548059 13973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:43693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.124.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:11.548346 13973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:11.548573 13973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:11.553221 13981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:11.553241 13979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:11.553256 13978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:11.553575 13973 server_base.cc:1034] running on GCE node
I20260929 22:57:11.553810 13973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:11.554044 13973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:11.555176 13973 hybrid_clock.cc:648] HybridClock initialized: now 1790722631555158 us; error 44 us; skew 500 ppm
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:11.557560 13973 init.cc:377] Logged in from keytab as kudu/127.0.124.189@KRBTEST.COM (short username kudu)
I20260929 22:57:11.557957 13973 webserver.cc:460] Webserver started at http://127.0.124.189:40891/ using document root <none> and password file <none>
I20260929 22:57:11.558185 13973 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:11.558229 13973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:11.558389 13973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:11.559410 13973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data/instance:
uuid: "da245163008148eab1a3332ea3cb6cfb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "b2b3ad02dd3ec70db74fefc529bc7c91"
server_key_iv: "ba22e79de4a73a9abfb924b9d4addb25"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.559759 13973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal/instance:
uuid: "da245163008148eab1a3332ea3cb6cfb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "b2b3ad02dd3ec70db74fefc529bc7c91"
server_key_iv: "ba22e79de4a73a9abfb924b9d4addb25"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.561115 13973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:57:11.561841 13988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:11.562006 13973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:11.562101 13973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "da245163008148eab1a3332ea3cb6cfb"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "b2b3ad02dd3ec70db74fefc529bc7c91"
server_key_iv: "ba22e79de4a73a9abfb924b9d4addb25"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.562152 13973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:11.569756 13973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:11.571475 13973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:11.571583 13973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:11.573217 13966 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } attempt: 2
I20260929 22:57:11.573626 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.573499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40842)
0929 22:57:11.573555 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.573590 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:57:11.573988 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.573861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40850)
0929 22:57:11.573907 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.573949 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260929 22:57:11.574117 13966 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:43693: Network error: Client connection negotiation failed: client connection to 127.0.124.189:43693: connect: Connection refused (error 111)
I20260929 22:57:11.575659 13973 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.189:43693
I20260929 22:57:11.575690 14040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.189:43693 every 8 connection(s)
I20260929 22:57:11.576035 13973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
I20260929 22:57:11.576952 14041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:11.578366 14041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.581303 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 13973
I20260929 22:57:11.581408 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-1/wal/instance
I20260929 22:57:11.581604 498 external_mini_cluster.cc:1428] Setting key 98998728f714ed279d65c5ef039656bb
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:11.587598 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.578949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49244 (local address 127.0.124.190:36993)
0929 22:57:11.578995 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.578998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.579211 (+ 213us) server_negotiation.cc:407] Connection header received
0929 22:57:11.579692 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.579693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.579703 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.579755 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.580351 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.580827 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.581930 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.582288 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.582361 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.584652 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.584653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.584653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.584659 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.586105 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.586631 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.586632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.586632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.586682 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.586973 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.586974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.586974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.587067 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.587113 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.587457 (+ 344us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.587541 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:57:11.587842 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.578945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36993 (local address 127.0.0.1:49244)
0929 22:57:11.579099 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.579132 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.579590 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.579804 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.579807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.580038 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.580271 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.580277 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.580900 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.580900 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.581852 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.581854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.582369 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.582369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.582467 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.582947 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.582954 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.584554 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.586189 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.586196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.586198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.586555 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.586751 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.586752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.586753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.586899 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.587131 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.587137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.587312 (+ 175us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.587426 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.587612 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260929 22:57:11.588411 14041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.0.124.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.188@KRBTEST.COM" created.
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:57:11.595790 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.588684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40858)
0929 22:57:11.588891 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.588901 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.588956 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.589087 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.589088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.589226 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.589281 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.589283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.590135 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.590136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.590703 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.590705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.591166 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.591167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.591217 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.591538 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.591542 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.592985 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.594848 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.594848 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.594849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.595000 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.595218 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.595219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.595219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.595266 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.595587 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.595588 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.595620 (+ 32us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.595672 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.595734 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260929 22:57:11.596093 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.588766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40858 (local address 127.0.124.189:43693)
0929 22:57:11.588886 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.588890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.588949 (+ 59us) server_negotiation.cc:407] Connection header received
0929 22:57:11.589012 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.589013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.589023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.589079 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.589355 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.590058 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.590782 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.591103 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.591160 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.593086 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.593094 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.593095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.593102 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.594766 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.595086 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.595090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.595090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.595153 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.595340 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.595340 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.595341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.595518 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.595607 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.595711 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.595815 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":98,"thread_start_us":77,"threads_started":1}
I20260929 22:57:11.596729 14041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.597061 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.596931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50854)
0929 22:57:11.596979 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.597043 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:57:11.597175 13989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
I20260929 22:57:11.597565 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.597476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50868)
0929 22:57:11.597521 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.597545 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:57:11.597672 14041 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:41531: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
I20260929 22:57:11.607422 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:41531
--webserver_interface=127.0.124.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:11.646965 14041 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } attempt: 1
I20260929 22:57:11.647547 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.647354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50884)
0929 22:57:11.647425 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.647509 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 22:57:11.647915 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.647816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50890)
0929 22:57:11.647863 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.647893 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:57:11.648061 14041 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:41531: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
I20260929 22:57:11.665262 13966 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } attempt: 3
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:57:11.672462 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.665619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40866)
0929 22:57:11.665675 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.665686 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.665755 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.665911 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.665912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.666084 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.666151 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.666153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.666839 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.666841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.667360 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.667361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.667760 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.667761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.667840 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.668389 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.668394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.669828 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.671441 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.671442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.671442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.671614 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.671835 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.671835 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.671836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.671895 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.672143 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.672144 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.672189 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.672293 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.672389 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260929 22:57:11.672581 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.665680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40866 (local address 127.0.124.189:43693)
0929 22:57:11.665742 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.665744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.665756 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:57:11.665820 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.665821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.665833 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.665907 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.666246 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.666755 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.667458 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.667684 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.667764 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.669915 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.669917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.669917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.669924 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.671347 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.671701 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.671702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.671703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.671759 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.671958 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.671959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.671959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.672072 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.672153 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.672365 (+ 212us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.672453 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:57:11.673249 13966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.673581 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.673481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50892)
0929 22:57:11.673528 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.673556 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:57:11.673913 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.673829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50894)
0929 22:57:11.673878 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.673898 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260929 22:57:11.674009 13966 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:41531: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
W20260929 22:57:11.687868 14048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:11.688053 14048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:11.688074 14048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:11.689246 14048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:11.689307 14048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:11.689321 14048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:11.689364 14048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:11.689390 14048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:11.690917 14048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36993,127.0.124.189:43693,127.0.124.188:41531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:41531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.124.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:11.691164 14048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:11.691416 14048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:11.696220 14056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:11.696271 14053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:11.696406 14048 server_base.cc:1034] running on GCE node
W20260929 22:57:11.696461 14054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:11.696708 14048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:11.697052 14048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:11.698191 14048 hybrid_clock.cc:648] HybridClock initialized: now 1790722631698170 us; error 36 us; skew 500 ppm
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:11.700572 14048 init.cc:377] Logged in from keytab as kudu/127.0.124.188@KRBTEST.COM (short username kudu)
I20260929 22:57:11.700970 14048 webserver.cc:460] Webserver started at http://127.0.124.188:40997/ using document root <none> and password file <none>
I20260929 22:57:11.701205 14048 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:11.701292 14048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:11.701506 14048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:11.702525 14048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data/instance:
uuid: "4855a6f122354ff6bf4c7d0b7c87e824"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "de6bc6b7c7907385fae06d887db7d3fb"
server_key_iv: "ff456c4df696a2bbdb8013a103e36d5c"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.702907 14048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal/instance:
uuid: "4855a6f122354ff6bf4c7d0b7c87e824"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "de6bc6b7c7907385fae06d887db7d3fb"
server_key_iv: "ff456c4df696a2bbdb8013a103e36d5c"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.704159 14048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:57:11.704873 14063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:11.705077 14048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:57:11.705191 14048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "4855a6f122354ff6bf4c7d0b7c87e824"
format_stamp: "Formatted at 2026-09-29 22:57:11 on dist-test-slave-512q"
server_key: "de6bc6b7c7907385fae06d887db7d3fb"
server_key_iv: "ff456c4df696a2bbdb8013a103e36d5c"
server_key_version: "encryptionkey@0"
I20260929 22:57:11.705185 13966 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } attempt: 1
I20260929 22:57:11.705271 14048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:11.705575 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.705442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50908)
0929 22:57:11.705502 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.705541 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 22:57:11.705935 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.705818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50916)
0929 22:57:11.705871 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.705904 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:57:11.706045 13966 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:41531: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
I20260929 22:57:11.716243 14041 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } attempt: 2
I20260929 22:57:11.716645 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.716530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50918)
0929 22:57:11.716586 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.716618 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:57:11.716958 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.716885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50920)
0929 22:57:11.716923 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.716944 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 22:57:11.717123 14041 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:41531: Network error: Client connection negotiation failed: client connection to 127.0.124.188:41531: connect: Connection refused (error 111)
I20260929 22:57:11.718719 14048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:11.720933 14048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:11.721100 14048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:11.724838 14048 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.188:41531
I20260929 22:57:11.724876 14115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.188:41531 every 8 connection(s)
I20260929 22:57:11.725234 14048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
I20260929 22:57:11.726070 14116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:11.727540 14116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:57:11.731906 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14048
I20260929 22:57:11.732000 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790722483574547-498-0/minicluster-data/master-2/wal/instance
I20260929 22:57:11.732252 498 external_mini_cluster.cc:1428] Setting key f441ec9dedba59afd0ca47a2579df9d1
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:11.736176 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.728200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.0.124.190:36993)
0929 22:57:11.728290 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.728293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.728442 (+ 149us) server_negotiation.cc:407] Connection header received
0929 22:57:11.728862 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.728863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.728872 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.728922 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.729457 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.729934 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.730845 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.731035 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.731087 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.733383 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.733385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.733385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.733391 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.734773 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.735227 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.735227 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.735228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.735275 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.735549 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.735550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.735550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.735679 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.735747 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.736021 (+ 274us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.736093 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260929 22:57:11.736439 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.728161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36993 (local address 127.0.0.1:49256)
0929 22:57:11.728332 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.728365 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.728783 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.728972 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.728975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.729213 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.729392 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.729395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.730008 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.730009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.730774 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.730776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.731104 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.731105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.731205 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.731599 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.731606 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.733295 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.734849 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.734855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.734857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.735156 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.735338 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.735338 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.735339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.735472 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.735745 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.735749 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.735852 (+ 103us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.735968 (+ 116us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.736145 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260929 22:57:11.737004 14116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:57:11.741402 14120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.732640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50928 (local address 127.0.124.188:41531)
0929 22:57:11.732985 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.732989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.733010 (+ 21us) server_negotiation.cc:407] Connection header received
0929 22:57:11.733036 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.733037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.733052 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.733110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.733786 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.734458 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.735428 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.735857 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.735907 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.738344 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.738350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.738350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.738355 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.740180 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.740580 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.740582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.740582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.740657 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.740851 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.740852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.740852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.741021 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.741163 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.741237 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.741312 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":93,"threads_started":1}
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:57:11.745223 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.737233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:43693 (local address 127.0.0.1:40880)
0929 22:57:11.737277 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.737300 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.737337 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.737996 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.737997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.738122 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.738163 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.738164 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.739063 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.739064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.740168 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.740170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.740657 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.740657 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.740736 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.741081 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.741086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.742655 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.744178 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.744179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.744179 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.744409 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.744621 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.744622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.744622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.744676 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.744931 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.744932 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.744969 (+ 37us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.745053 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.745137 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:57:11.745234 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.737321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40880 (local address 127.0.124.189:43693)
0929 22:57:11.737386 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.737388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.737396 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:57:11.737422 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.737423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.737434 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.737495 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.738246 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.738968 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.740283 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.740590 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.740654 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.742749 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.742750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.742751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.742756 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.744107 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.744485 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.744486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.744486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.744554 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.744750 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.744751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.744751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.744859 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.744927 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.745079 (+ 152us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.745149 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:57:11.745771 14116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:11.749176 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.742222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49268 (local address 127.0.124.190:36993)
0929 22:57:11.742256 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.742258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.742283 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:57:11.742301 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.742302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.742310 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.742362 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.742908 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.743337 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.743984 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.744202 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.744286 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.746474 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.746475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.746475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.746482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.748024 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.748393 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.748393 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.748394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.748442 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.748641 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.748642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.748643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.748769 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.748972 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.749014 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.749086 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:57:11.752693 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.746010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50934)
0929 22:57:11.746110 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.746119 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.746164 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.746289 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.746290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.746389 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.746413 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.746414 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.747187 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.747188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.747993 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.747996 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.748536 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.748537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.748584 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.748950 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.748955 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.750104 (+ 1149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.751721 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.751722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.751722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.751926 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.752135 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.752136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.752136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.752198 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.752445 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.752446 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.752485 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.752553 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.752641 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260929 22:57:11.752779 14120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.746054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.0.124.188:41531)
0929 22:57:11.746088 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.746090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.746151 (+ 61us) server_negotiation.cc:407] Connection header received
0929 22:57:11.746208 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.746209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.746219 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.746288 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.746517 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.747085 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.748104 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.748441 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.748529 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.750207 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.750208 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.750208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.750214 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.751647 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.752024 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.752025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.752025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.752072 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.752291 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.752291 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.752291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.752385 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.752433 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.752579 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.752698 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":20}
I20260929 22:57:11.754029 14116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: Bootstrap starting.
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:57:11.754882 14116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:11.755160 14116 log.cc:824] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:11.755946 14116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: No bootstrap required, opened a new log
I20260929 22:57:11.757807 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.750219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40882 (local address 127.0.124.189:43693)
0929 22:57:11.750258 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.750260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.750266 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:57:11.750288 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.750289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.750298 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.750356 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.750901 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.751618 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.752569 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.752926 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.753002 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.755117 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.755118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.755118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.755125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.756762 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.757083 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.757084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.757084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.757141 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.757313 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.757314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.757314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.757435 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.757607 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.757644 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.757712 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:57:11.758194 14116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.758345 14116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:11.758389 14116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855a6f122354ff6bf4c7d0b7c87e824, State: Initialized, Role: FOLLOWER
I20260929 22:57:11.758502 14116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.758786 14122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.758834 14116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:11.758904 14122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:57:11.759274 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260929 22:57:11.760782 14135 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:57:11.761024 14135 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:57:11.761170 14048 master_runner.cc:186] Error getting master registration for 127.0.124.190:36993: OK, instance_id { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" instance_seqno: 1790722631438165 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:57:11.763429 14048 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:57:11.768353 14120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.760992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50940 (local address 127.0.124.188:41531)
0929 22:57:11.761054 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.761056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.761063 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:57:11.761082 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.761083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.761091 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.761142 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.761789 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.762547 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.763497 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.763754 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.763796 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.765456 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.765457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.765457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.765464 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.767055 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.767449 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.767450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.767450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.767502 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.767702 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.767703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.767703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.767844 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.767912 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.768127 (+ 215us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.768201 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:57:11.768919 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.760894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40892 (local address 127.0.124.189:43693)
0929 22:57:11.760943 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.760945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.760951 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:57:11.760969 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.760969 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.760977 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.761013 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.761771 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.762417 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.763380 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.763651 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.763688 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.765285 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.765286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.765286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.765293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.766899 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.767318 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.767319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.767320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.767374 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.767583 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.767584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.767584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.767694 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.768357 (+ 663us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.768715 (+ 358us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.768793 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:57:11.772811 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.764527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.0.124.190:36993)
0929 22:57:11.764568 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.764570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.764653 (+ 83us) server_negotiation.cc:407] Connection header received
0929 22:57:11.764790 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.764791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.764802 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.764833 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.766451 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.767160 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.768182 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.768506 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.768563 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.770031 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.770032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.770033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.770040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.771396 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.771752 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.771753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.771753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.771803 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.772006 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.772006 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.772007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.772113 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.772667 (+ 554us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.772700 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.772754 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:57:11.781172 13966 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } attempt: 2
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:57:11.787748 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.781424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50956)
0929 22:57:11.781496 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.781508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.781550 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.781664 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.781665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.781818 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.781856 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.781858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.782389 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.782390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.783155 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.783157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.783582 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.783583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.783642 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.784003 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.784008 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.785225 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.786732 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.786733 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.786734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.786900 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.787112 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.787113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.787113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.787188 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.787438 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.787439 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.787487 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.787570 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.787659 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260929 22:57:11.787746 14120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.781501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50956 (local address 127.0.124.188:41531)
0929 22:57:11.781555 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.781556 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.781562 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:57:11.781600 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.781600 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.781606 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.781649 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.781922 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.782319 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.783247 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.783509 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.783562 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.785321 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.785322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.785322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.785329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.786635 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.786989 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.786990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.786991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.787046 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.787249 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.787250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.787250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.787348 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.787433 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.787595 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.787659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:57:11.789500 13966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: Bootstrap starting.
I20260929 22:57:11.790243 13966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:11.790601 13966 log.cc:824] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:11.791391 13966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: No bootstrap required, opened a new log
I20260929 22:57:11.793437 13966 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.793579 13966 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:11.793614 13966 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a4cc585e0b4c5b9ac898d4a6ad99fb, State: Initialized, Role: FOLLOWER
I20260929 22:57:11.793757 13966 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.794013 14143 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.794062 13966 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:11.794116 14143 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:57:11.795892 14154 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:57:11.795989 14154 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:57:11.796419 13898 master_runner.cc:186] Error getting master registration for 127.0.124.189:43693: OK, instance_id { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" instance_seqno: 1790722631574601 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:57:11.798614 13898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:57:11.808260 14041 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } attempt: 3
Sep 29 22:57:11 dist-test-slave-512q krb5kdc[13885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722631, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:57:11.831310 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.808550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:41531 (local address 127.0.0.1:50970)
0929 22:57:11.808602 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:11.808613 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:11.808650 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:11.808792 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:11.808793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:11.808978 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:11.809041 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.809043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.809949 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.809950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.810774 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:11.810776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.811239 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.811240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:11.811298 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.811839 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:11.811844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:11.813345 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:11.827070 (+ 13725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.827072 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.827073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.827317 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.830614 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:11.830615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:11.830616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:11.830683 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:11.830976 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:11.830977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:11.831024 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 22:57:11.831091 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:57:11.831202 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:57:11.831830 14120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:11.808610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.0.124.188:41531)
0929 22:57:11.808657 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:11.808659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:11.808670 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:57:11.808710 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:11.808711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:11.808720 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:11.808773 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:11.809121 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.809863 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.810859 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:11.811159 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:11.811231 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:11.813429 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:11.813430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:11.813431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:11.813439 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:11.825872 (+ 12433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.830434 (+ 4562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.830436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.830436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.830521 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:11.830749 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:11.830750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:11.830750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:11.830889 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:11.830948 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:11.831659 (+ 711us) server_negotiation.cc:299] Negotiation successful
0929 22:57:11.831741 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:57:11.833591 14041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: Bootstrap starting.
I20260929 22:57:11.834280 14041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:11.834580 14041 log.cc:824] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:11.835431 14041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: No bootstrap required, opened a new log
I20260929 22:57:11.837435 14041 raft_consensus.cc:348] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.837569 14041 raft_consensus.cc:374] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:11.837599 14041 raft_consensus.cc:729] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da245163008148eab1a3332ea3cb6cfb, State: Initialized, Role: FOLLOWER
I20260929 22:57:11.837704 14041 consensus_queue.cc:260] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.838011 14041 sys_catalog.cc:564] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:11.837990 14157 sys_catalog.cc:455] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.839582 14157 sys_catalog.cc:458] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:57:11.839948 14168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:57:11.840055 14168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:57:11.842238 13973 master_runner.cc:263] No leader master found from master da245163008148eab1a3332ea3cb6cfb
I20260929 22:57:11.842293 13973 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:57:11.850097 14143 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:11.850216 14143 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.850445 14143 leader_election.cc:288] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da245163008148eab1a3332ea3cb6cfb (127.0.124.189:43693), 4855a6f122354ff6bf4c7d0b7c87e824 (127.0.124.188:41531)
I20260929 22:57:11.850750 14090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" is_pre_election: true
I20260929 22:57:11.850783 14015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da245163008148eab1a3332ea3cb6cfb" is_pre_election: true
I20260929 22:57:11.850883 14090 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6a4cc585e0b4c5b9ac898d4a6ad99fb in term 0.
I20260929 22:57:11.850909 14015 raft_consensus.cc:2454] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6a4cc585e0b4c5b9ac898d4a6ad99fb in term 0.
I20260929 22:57:11.851090 13914 leader_election.cc:302] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6a4cc585e0b4c5b9ac898d4a6ad99fb, da245163008148eab1a3332ea3cb6cfb; no voters:
I20260929 22:57:11.851272 14143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:11.851327 14143 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:11.851362 14143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:11.852345 14143 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.852473 14143 leader_election.cc:288] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [CANDIDATE]: Term 1 election: Requested vote from peers da245163008148eab1a3332ea3cb6cfb (127.0.124.189:43693), 4855a6f122354ff6bf4c7d0b7c87e824 (127.0.124.188:41531)
I20260929 22:57:11.852672 14090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855a6f122354ff6bf4c7d0b7c87e824"
I20260929 22:57:11.852751 14090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:11.853602 14090 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6a4cc585e0b4c5b9ac898d4a6ad99fb in term 1.
I20260929 22:57:11.853797 14015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da245163008148eab1a3332ea3cb6cfb"
I20260929 22:57:11.853873 14015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:11.854748 14015 raft_consensus.cc:2454] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6a4cc585e0b4c5b9ac898d4a6ad99fb in term 1.
I20260929 22:57:11.854858 13914 leader_election.cc:302] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4855a6f122354ff6bf4c7d0b7c87e824, d6a4cc585e0b4c5b9ac898d4a6ad99fb; no voters:
I20260929 22:57:11.855569 14143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:11.855737 14143 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [term 1 LEADER]: Becoming Leader. State: Replica: d6a4cc585e0b4c5b9ac898d4a6ad99fb, State: Running, Role: LEADER
I20260929 22:57:11.855836 14143 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } }
I20260929 22:57:11.856305 14143 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a4cc585e0b4c5b9ac898d4a6ad99fb. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.856387 14143 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:11.857242 14172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:11.857439 14172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:11.858940 14090 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [term 1 FOLLOWER]: Refusing update from remote peer d6a4cc585e0b4c5b9ac898d4a6ad99fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:11.859261 14170 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:11.860548 14122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a4cc585e0b4c5b9ac898d4a6ad99fb. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.860653 14122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:57:11.860991 14015 raft_consensus.cc:1261] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [term 1 FOLLOWER]: Refusing update from remote peer d6a4cc585e0b4c5b9ac898d4a6ad99fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:11.861264 14170 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:11.862337 14157 sys_catalog.cc:455] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a4cc585e0b4c5b9ac898d4a6ad99fb. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.862426 14157 sys_catalog.cc:458] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:57:11.863574 14170 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.863658 14170 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:11.864130 14122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.864302 14122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:57:11.864455 14173 mvcc.cc:205] Tried to move back new op lower bound from 7334799900091904000 to 7334799900082143232. Current Snapshot: MvccSnapshot[applied={T|T < 7334799900091904000}]
I20260929 22:57:11.864599 14174 mvcc.cc:205] Tried to move back new op lower bound from 7334799900091904000 to 7334799900082143232. Current Snapshot: MvccSnapshot[applied={T|T < 7334799900091904000}]
I20260929 22:57:11.865443 14172 catalog_manager.cc:1347] Generated new cluster ID: 6d6316ef20404951b1ab3cd6bf37300f
I20260929 22:57:11.865497 14172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:11.873667 14172 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:57:11.874410 14172 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:11.880684 14170 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.880784 14170 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:11.881358 14157 sys_catalog.cc:455] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a4cc585e0b4c5b9ac898d4a6ad99fb" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36993 } } peers { permanent_uuid: "da245163008148eab1a3332ea3cb6cfb" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 43693 } } peers { permanent_uuid: "4855a6f122354ff6bf4c7d0b7c87e824" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 41531 } } }
I20260929 22:57:11.881469 14157 sys_catalog.cc:458] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:57:11.881539 14176 mvcc.cc:205] Tried to move back new op lower bound from 7334799900091904000 to 7334799900082143232. Current Snapshot: MvccSnapshot[applied={T|T < 7334799900091904000}]
I20260929 22:57:11.885573 14172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6a4cc585e0b4c5b9ac898d4a6ad99fb: Generated new TSK 0
I20260929 22:57:11.885747 14172 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:57:12.761499 14135 catalog_manager.cc:1259] Loaded cluster ID: 6d6316ef20404951b1ab3cd6bf37300f
I20260929 22:57:12.761572 14135 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: loading cluster ID for follower catalog manager: success
I20260929 22:57:12.762365 14135 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: acquiring CA information for follower catalog manager: success
I20260929 22:57:12.762678 14135 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4855a6f122354ff6bf4c7d0b7c87e824: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:57:12.840507 14168 catalog_manager.cc:1259] Loaded cluster ID: 6d6316ef20404951b1ab3cd6bf37300f
I20260929 22:57:12.840582 14168 catalog_manager.cc:1552] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: loading cluster ID for follower catalog manager: success
I20260929 22:57:12.841434 14168 catalog_manager.cc:1574] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: acquiring CA information for follower catalog manager: success
I20260929 22:57:12.841797 14168 catalog_manager.cc:1602] T 00000000000000000000000000000000 P da245163008148eab1a3332ea3cb6cfb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:57:12.947893 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13898
I20260929 22:57:12.952935 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 13973
I20260929 22:57:12.957311 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14048
2026-09-29T22:57:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2785 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:57:13 dist-test-slave-512q krb5kdc[14190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:57:13 dist-test-slave-512q krb5kdc[14190](info): set up 2 sockets
Sep 29 22:57:13 dist-test-slave-512q krb5kdc[14190](info): commencing operation
krb5kdc: starting...
W20260929 22:57:13.998728 498 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:57:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:57:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:57:14.112447 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35933
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:35933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:14.192741 14203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:14.192930 14203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:14.192951 14203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:14.194104 14203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:14.194149 14203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:14.194164 14203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:14.194214 14203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:14.194231 14203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:14.195647 14203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:35933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:14.195886 14203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:14.196133 14203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:14.200860 14208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:14.200884 14211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:14.200874 14209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:14.201140 14203 server_base.cc:1034] running on GCE node
I20260929 22:57:14.201361 14203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:14.201594 14203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:14.202734 14203 hybrid_clock.cc:648] HybridClock initialized: now 1790722634202721 us; error 27 us; skew 500 ppm
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722634, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:14.205179 14203 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:14.205571 14203 webserver.cc:460] Webserver started at http://127.0.124.190:37687/ using document root <none> and password file <none>
I20260929 22:57:14.205807 14203 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:14.205852 14203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:14.205999 14203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:14.207019 14203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "e13dad957470419085a4f096802f609b"
format_stamp: "Formatted at 2026-09-29 22:57:14 on dist-test-slave-512q"
server_key: "57718b26887bd43ae3f9483d9276f969"
server_key_iv: "f22df4925f00b8fcdb8e5fe2f9650a69"
server_key_version: "encryptionkey@0"
I20260929 22:57:14.207412 14203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "e13dad957470419085a4f096802f609b"
format_stamp: "Formatted at 2026-09-29 22:57:14 on dist-test-slave-512q"
server_key: "57718b26887bd43ae3f9483d9276f969"
server_key_iv: "f22df4925f00b8fcdb8e5fe2f9650a69"
server_key_version: "encryptionkey@0"
I20260929 22:57:14.208774 14203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:57:14.209499 14218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:14.209681 14203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:14.209769 14203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "e13dad957470419085a4f096802f609b"
format_stamp: "Formatted at 2026-09-29 22:57:14 on dist-test-slave-512q"
server_key: "57718b26887bd43ae3f9483d9276f969"
server_key_iv: "f22df4925f00b8fcdb8e5fe2f9650a69"
server_key_version: "encryptionkey@0"
I20260929 22:57:14.209841 14203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:14.231022 14203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:14.233376 14203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:14.233561 14203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:14.237347 14203 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:35933
I20260929 22:57:14.237404 14270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:35933 every 8 connection(s)
I20260929 22:57:14.237753 14203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:14.238695 14271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:14.240898 14271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b: Bootstrap starting.
I20260929 22:57:14.241416 14271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:14.241647 14271 log.cc:824] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:14.242254 14271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b: No bootstrap required, opened a new log
I20260929 22:57:14.243741 14271 raft_consensus.cc:348] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } }
I20260929 22:57:14.243875 14271 raft_consensus.cc:374] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:14.243898 14271 raft_consensus.cc:729] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13dad957470419085a4f096802f609b, State: Initialized, Role: FOLLOWER
I20260929 22:57:14.244038 14271 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } }
I20260929 22:57:14.244120 14271 raft_consensus.cc:388] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:14.244143 14271 raft_consensus.cc:482] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:14.244172 14271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:14.244647 14271 raft_consensus.cc:504] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } }
I20260929 22:57:14.244728 14271 leader_election.cc:302] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13dad957470419085a4f096802f609b; no voters:
I20260929 22:57:14.244863 14271 leader_election.cc:288] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:57:14.244931 14274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:14.245107 14274 raft_consensus.cc:686] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [term 1 LEADER]: Becoming Leader. State: Replica: e13dad957470419085a4f096802f609b, State: Running, Role: LEADER
I20260929 22:57:14.245142 14271 sys_catalog.cc:564] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:14.245198 14274 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } }
I20260929 22:57:14.245561 14275 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13dad957470419085a4f096802f609b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } } }
I20260929 22:57:14.245654 14275 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:14.245565 14276 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13dad957470419085a4f096802f609b. Latest consensus state: current_term: 1 leader_uuid: "e13dad957470419085a4f096802f609b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13dad957470419085a4f096802f609b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35933 } } }
I20260929 22:57:14.245797 14276 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:14.245946 14278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:14.246595 14278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:14.246896 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14203
I20260929 22:57:14.247002 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:57:14.247182 498 external_mini_cluster.cc:1428] Setting key 7d5ba10ca251fe10c9d36217b85cd343
I20260929 22:57:14.249794 14278 catalog_manager.cc:1347] Generated new cluster ID: 517a819c561840e4a3f2fb1a992fc5bb
I20260929 22:57:14.249848 14278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:14.257287 14293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:14.247636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52602 (local address 127.0.124.190:35933)
0929 22:57:14.247778 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:14.247787 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:14.248331 (+ 544us) server_negotiation.cc:407] Connection header received
0929 22:57:14.248476 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:14.248483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:14.248547 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:14.248705 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:14.249425 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:14.250482 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:14.251265 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:14.251683 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:14.251801 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:14.254112 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:14.254116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:14.254116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:14.254128 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:14.255733 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:14.256110 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:14.256114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:14.256114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:14.256254 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:14.256483 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:14.256483 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:14.256484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:14.256707 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:14.256878 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:14.256945 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:57:14.257097 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260929 22:57:14.258208 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:57:14.265282 14278 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:57:14.265769 14278 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:14.272460 14278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e13dad957470419085a4f096802f609b: Generated new TSK 0
I20260929 22:57:14.272639 14278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:57:14.312235 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14203
2026-09-29T22:57:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1354 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14298](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14298](info): set up 2 sockets
Sep 29 22:57:14 dist-test-slave-512q krb5kdc[14298](info): commencing operation
krb5kdc: starting...
W20260929 22:57:15.346551 498 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:57:15.462301 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:38277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:15.540567 14311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:15.540764 14311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:15.540786 14311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:15.542057 14311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:15.542096 14311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:15.542110 14311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:15.542122 14311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:15.542171 14311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:15.543556 14311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:38277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:15.543795 14311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:15.544018 14311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:15.548669 14316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:15.548650 14319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:15.548646 14317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:15.548817 14311 server_base.cc:1034] running on GCE node
I20260929 22:57:15.549199 14311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:15.549461 14311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:15.550623 14311 hybrid_clock.cc:648] HybridClock initialized: now 1790722635550603 us; error 33 us; skew 500 ppm
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:15.557598 14311 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:15.557965 14311 webserver.cc:460] Webserver started at http://127.0.124.190:46607/ using document root <none> and password file <none>
I20260929 22:57:15.558143 14311 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:15.558182 14311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:15.558265 14311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:15.559221 14311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "559d08f3effa44678d3875526ab8b399"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "0e8512b8f4363d911dc23490b3ff9b9e"
server_key_iv: "7fc889d54cf85e17e8a913c6f03112a6"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.559510 14311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "559d08f3effa44678d3875526ab8b399"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "0e8512b8f4363d911dc23490b3ff9b9e"
server_key_iv: "7fc889d54cf85e17e8a913c6f03112a6"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.560915 14311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:57:15.561615 14326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.561800 14311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.561887 14311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "559d08f3effa44678d3875526ab8b399"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "0e8512b8f4363d911dc23490b3ff9b9e"
server_key_iv: "7fc889d54cf85e17e8a913c6f03112a6"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.561959 14311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:15.580415 14311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:15.582788 14311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:15.582952 14311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:15.587214 14311 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:38277
I20260929 22:57:15.587294 14378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:38277 every 8 connection(s)
I20260929 22:57:15.587611 14311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:15.588637 14379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:15.590899 14379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap starting.
I20260929 22:57:15.591480 14379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:15.591763 14379 log.cc:824] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:15.592485 14379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: No bootstrap required, opened a new log
I20260929 22:57:15.594072 14379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:15.594205 14379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:15.594255 14379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Initialized, Role: FOLLOWER
I20260929 22:57:15.594408 14379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:15.594491 14379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:15.594542 14379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:15.594590 14379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:15.595371 14379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:15.595484 14379 leader_election.cc:302] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559d08f3effa44678d3875526ab8b399; no voters:
I20260929 22:57:15.595634 14379 leader_election.cc:288] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:57:15.595688 14382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:15.595860 14382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 LEADER]: Becoming Leader. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Running, Role: LEADER
I20260929 22:57:15.595893 14379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:15.595955 14382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:15.596319 14383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:15.596328 14384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559d08f3effa44678d3875526ab8b399. Latest consensus state: current_term: 1 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:15.596415 14383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:15.596422 14384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:15.596650 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14311
I20260929 22:57:15.596757 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:57:15.596944 498 external_mini_cluster.cc:1428] Setting key 24af3892de1c17bb37e81eba99d5b1b4
I20260929 22:57:15.597635 14389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:15.598208 14389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:15.599900 14389 catalog_manager.cc:1347] Generated new cluster ID: 24f95967a53744e098d32b0aabd70bfa
I20260929 22:57:15.599951 14389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:15.607059 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:15.597420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34056 (local address 127.0.124.190:38277)
0929 22:57:15.597667 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:15.597676 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:15.597709 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:57:15.597829 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:15.597837 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:15.597900 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:15.598872 (+ 972us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:15.598971 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.600254 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.601024 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.601448 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.601581 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:15.603839 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:15.603843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:15.603843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:15.603854 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:15.605541 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:15.605918 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:15.605921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:15.605921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:15.606029 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:15.606249 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:15.606250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:15.606250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:15.606478 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:15.606644 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:15.606712 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:57:15.606849 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":69,"threads_started":1}
I20260929 22:57:15.651751 14389 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:57:15.652530 14389 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:15.655866 14389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Generated new TSK 0
I20260929 22:57:15.656054 14389 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:57:15.690851 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:15.770430 14405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:15.770638 14405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:15.770675 14405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:15.771797 14405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:15.771860 14405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:15.771905 14405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:15.773401 14405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:15.773640 14405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:15.773870 14405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:15.778574 14411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:15.778602 14413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:15.778625 14410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:15.778678 14405 server_base.cc:1034] running on GCE node
I20260929 22:57:15.778980 14405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:15.779202 14405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:15.780333 14405 hybrid_clock.cc:648] HybridClock initialized: now 1790722635780321 us; error 68 us; skew 500 ppm
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:15.782660 14405 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:15.783059 14405 webserver.cc:460] Webserver started at http://127.0.124.129:33617/ using document root <none> and password file <none>
I20260929 22:57:15.783284 14405 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:15.783351 14405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:15.783499 14405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:15.784546 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "b67c7591f86e4aed8beca9416ad105f1"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "5fea30213f2d217ccf7433ad906d2dc2"
server_key_iv: "ac3a3d202afe2f4d66c9908409136916"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.784888 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "b67c7591f86e4aed8beca9416ad105f1"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "5fea30213f2d217ccf7433ad906d2dc2"
server_key_iv: "ac3a3d202afe2f4d66c9908409136916"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.786249 14405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:15.786931 14420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.787102 14405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:15.787189 14405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "b67c7591f86e4aed8beca9416ad105f1"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "5fea30213f2d217ccf7433ad906d2dc2"
server_key_iv: "ac3a3d202afe2f4d66c9908409136916"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.787268 14405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:15.823547 14405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:15.825927 14405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:15.826083 14405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:15.826313 14405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:15.826619 14405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:15.826689 14405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.826730 14405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:15.826756 14405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.833150 14405 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:43111
I20260929 22:57:15.833194 14533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:43111 every 8 connection(s)
I20260929 22:57:15.833493 14405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:15.836009 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14405
I20260929 22:57:15.836112 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:57:15.836310 498 external_mini_cluster.cc:1428] Setting key 75c01a0b15070b56e55e1987ba4707e8
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:15.844103 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:15.834268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:48831 (local address 127.0.124.190:38277)
0929 22:57:15.834344 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:15.834346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:15.834501 (+ 155us) server_negotiation.cc:407] Connection header received
0929 22:57:15.834951 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:15.834952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:15.834961 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:15.835027 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:15.836139 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.836927 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.838455 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.838802 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.838910 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:15.841019 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:15.841020 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:15.841021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:15.841030 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:15.842470 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:15.843049 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:15.843050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:15.843050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:15.843105 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:15.843416 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:15.843416 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:15.843417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:15.843512 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:15.843564 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:15.843935 (+ 371us) server_negotiation.cc:299] Negotiation successful
0929 22:57:15.844041 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:57:15.844380 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:15.834223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:48831)
0929 22:57:15.834389 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:15.834423 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:15.834872 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:15.835077 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:15.835080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:15.835747 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:15.835989 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:15.835995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.837030 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.837031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:15.838371 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:15.838374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:15.838915 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:15.838916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:15.839036 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:15.839516 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:15.839523 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:15.840929 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:15.842604 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:15.842612 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:15.842615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:15.842940 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:15.843200 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:15.843201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:15.843201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:15.843343 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:15.843582 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:15.843589 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:15.843751 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 22:57:15.843909 (+ 158us) client_negotiation.cc:240] Negotiation successful
0929 22:57:15.844097 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260929 22:57:15.844931 14534 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:15.845046 14534 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
I20260929 22:57:15.845216 14534 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:15.845754 14343 ts_manager.cc:194] Registered new tserver with Master: b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:15.846386 14343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:48831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:57:15.862574 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:15.945739 14539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:15.945945 14539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:15.945982 14539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:15.947180 14539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:15.947218 14539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:15.947270 14539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:15.948740 14539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:15.948969 14539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:15.949195 14539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:15.954109 14545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:15.954304 14539 server_base.cc:1034] running on GCE node
W20260929 22:57:15.954066 14547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:15.954092 14544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:15.954579 14539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:15.954808 14539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:15.955940 14539 hybrid_clock.cc:648] HybridClock initialized: now 1790722635955932 us; error 25 us; skew 500 ppm
Sep 29 22:57:15 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:15.958436 14539 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:15.958918 14539 webserver.cc:460] Webserver started at http://127.0.124.130:44677/ using document root <none> and password file <none>
I20260929 22:57:15.959162 14539 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:15.959208 14539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:15.959349 14539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:15.960438 14539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "2bcaad7f93694087ac5ce85890df4676"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "f94bf7a5c371c4b8800543d71d75fad2"
server_key_iv: "0efffc3efc7afff0e698a20e94ab105e"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.960806 14539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "2bcaad7f93694087ac5ce85890df4676"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "f94bf7a5c371c4b8800543d71d75fad2"
server_key_iv: "0efffc3efc7afff0e698a20e94ab105e"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.962096 14539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:15.962792 14554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.962956 14539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:15.963032 14539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "2bcaad7f93694087ac5ce85890df4676"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "f94bf7a5c371c4b8800543d71d75fad2"
server_key_iv: "0efffc3efc7afff0e698a20e94ab105e"
server_key_version: "encryptionkey@0"
I20260929 22:57:15.963083 14539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:15.988543 14539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:15.990734 14539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:15.990892 14539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:15.991091 14539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:15.991333 14539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:15.991364 14539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.991384 14539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:15.991396 14539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:15.997300 14539 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39215
I20260929 22:57:15.997345 14667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39215 every 8 connection(s)
I20260929 22:57:15.997651 14539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:16.006240 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:15.998399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:42071 (local address 127.0.124.190:38277)
0929 22:57:15.998455 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:15.998457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:15.998661 (+ 204us) server_negotiation.cc:407] Connection header received
0929 22:57:15.999145 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:15.999146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:15.999156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:15.999210 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.000090 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.000653 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.001582 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.001763 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.001817 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.003859 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.003860 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.003860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.003867 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.005148 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.005496 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.005497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.005497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.005545 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.005747 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.005747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.005748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.005841 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.005890 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.006115 (+ 225us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.006179 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:57:16.006444 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:15.998394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:42071)
0929 22:57:15.998542 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:15.998575 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:15.999058 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:15.999259 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:15.999262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:15.999808 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:15.999988 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:15.999993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.000730 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.000731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.001503 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.001505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.001835 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.001836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.001926 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.002329 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.002337 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.003657 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.005217 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.005222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.005224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.005431 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.005604 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.005604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.005605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.005695 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.005894 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.005897 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.006001 (+ 104us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.006091 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.006201 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260929 22:57:16.006964 14668 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:16.007076 14668 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:16.007244 14668 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:16.007328 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14539
I20260929 22:57:16.007431 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:57:16.007612 498 external_mini_cluster.cc:1428] Setting key d361dd8fe95bee92aa2f69fd375fd0f8
I20260929 22:57:16.007643 14343 ts_manager.cc:194] Registered new tserver with Master: 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
I20260929 22:57:16.008136 14343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:42071
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:57:16.031610 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:16.112910 14673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:16.113095 14673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:16.113117 14673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:16.114157 14673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:16.114192 14673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:16.114216 14673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:16.115530 14673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:16.115696 14673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:16.115875 14673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:16.120631 14681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.120639 14678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.120673 14679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:16.120656 14673 server_base.cc:1034] running on GCE node
I20260929 22:57:16.121086 14673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:16.121309 14673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:16.122570 14673 hybrid_clock.cc:648] HybridClock initialized: now 1790722636122560 us; error 30 us; skew 500 ppm
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:16.124925 14673 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:16.125366 14673 webserver.cc:460] Webserver started at http://127.0.124.131:39003/ using document root <none> and password file <none>
I20260929 22:57:16.125595 14673 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:16.125662 14673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:16.125806 14673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:16.126772 14673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
format_stamp: "Formatted at 2026-09-29 22:57:16 on dist-test-slave-512q"
server_key: "3c1f911a560e06dbea89f77152f8b87c"
server_key_iv: "1e627359a283bfba8682050d4d79dd94"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.127121 14673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
format_stamp: "Formatted at 2026-09-29 22:57:16 on dist-test-slave-512q"
server_key: "3c1f911a560e06dbea89f77152f8b87c"
server_key_iv: "1e627359a283bfba8682050d4d79dd94"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.128405 14673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:57:16.129107 14688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.129266 14673 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:16.129359 14673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
format_stamp: "Formatted at 2026-09-29 22:57:16 on dist-test-slave-512q"
server_key: "3c1f911a560e06dbea89f77152f8b87c"
server_key_iv: "1e627359a283bfba8682050d4d79dd94"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.129432 14673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:16.135484 14673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:16.137249 14673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:16.137396 14673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:16.137609 14673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:16.137902 14673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:16.137950 14673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.137997 14673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:16.138023 14673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.143719 14673 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35399
I20260929 22:57:16.143767 14801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35399 every 8 connection(s)
I20260929 22:57:16.144053 14673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:16.145774 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14673
I20260929 22:57:16.145892 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:57:16.146090 498 external_mini_cluster.cc:1428] Setting key 1635bb307c242cf1c0a3dd5b78d29256
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:16.152945 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.144751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:49143 (local address 127.0.124.190:38277)
0929 22:57:16.144815 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.144817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.144998 (+ 181us) server_negotiation.cc:407] Connection header received
0929 22:57:16.145514 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.145516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.145528 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.145598 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.146856 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.147420 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.148388 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.148565 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.148615 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.150697 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.150698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.150698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.150704 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.151840 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.152181 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.152182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.152182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.152275 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.152488 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.152489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.152489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.152580 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.152629 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.152833 (+ 204us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.152887 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:57:16.153084 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.144720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:49143)
0929 22:57:16.144879 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.144916 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.145398 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.145684 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.145689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.146476 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:16.146743 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.146755 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.147489 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.147490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.148322 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.148325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.148632 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.148632 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.148723 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.149236 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.149244 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.150623 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.151908 (+ 1285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.151913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.151914 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.152117 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.152340 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.152341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.152341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.152433 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.152632 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.152636 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.152731 (+ 95us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.152806 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.152908 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260929 22:57:16.153545 14802 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:16.153640 14802 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:16.153798 14802 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:16.154172 14342 ts_manager.cc:194] Registered new tserver with Master: cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399)
I20260929 22:57:16.154534 14342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:49143
I20260929 22:57:16.157871 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:16.164338 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.159172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.0.124.190:38277)
0929 22:57:16.159243 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.159245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.159306 (+ 61us) server_negotiation.cc:407] Connection header received
0929 22:57:16.159343 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.159344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.159351 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.159395 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.159887 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.160379 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.161048 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.161208 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.161253 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.162326 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.162326 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.162326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.162331 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.163369 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.163656 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.163657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.163657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.163699 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.163853 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.163853 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.163853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.163977 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.164049 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.164156 (+ 107us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.164268 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:57:16.166285 14342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:57:16.168154 14342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:57:16.174299 14813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39215 (local address 127.0.0.1:56272)
0929 22:57:16.170483 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.170531 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.170595 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.171090 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.171093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.171096 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.171167 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.171169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.172053 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.172055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.173124 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.173127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.174022 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.174023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.174099 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.174111 (+ 12us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.174179 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.174229 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":3,"thread_start_us":72,"threads_started":1}
I20260929 22:57:16.174319 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56272 (local address 127.0.124.130:39215)
0929 22:57:16.170909 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.170914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.170923 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:16.170960 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.170969 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.170984 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.171069 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.171257 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.171948 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.173221 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.173941 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.174029 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.174086 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.174201 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.174240 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260929 22:57:16.174782 14815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.0.1:53040)
0929 22:57:16.170785 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.170795 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.170856 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.171129 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.171130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.171133 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.171194 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.171196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.172545 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.172546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.173577 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.173579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.174539 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.174541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.174603 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.174607 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.174656 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.174695 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":78,"threads_started":1}
I20260929 22:57:16.175072 14816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53040 (local address 127.0.124.129:43111)
0929 22:57:16.170795 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.170800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.170843 (+ 43us) server_negotiation.cc:407] Connection header received
0929 22:57:16.170929 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.170930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.170942 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.171006 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.171277 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.172437 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.173669 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.174388 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.174455 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.174505 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.174947 (+ 442us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.175010 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":92,"threads_started":1}
I20260929 22:57:16.175154 14602 tablet_service.cc:1467] Processing CreateTablet for tablet 02e70309e59e4f0f9a7f42967984b06a (DEFAULT_TABLE table=test-table [id=34679f853e0940e9b38413a3934859dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.175527 14602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e70309e59e4f0f9a7f42967984b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.176728 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35399 (local address 127.0.0.1:54282)
0929 22:57:16.171167 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.171177 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.171224 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.171454 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.171456 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.171457 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.171490 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.171492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.172692 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.172693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.173764 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.173767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.176489 (+ 2722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.176490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.176551 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.176554 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.176627 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.176665 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":78,"threads_started":1}
I20260929 22:57:16.176824 14468 tablet_service.cc:1467] Processing CreateTablet for tablet 02e70309e59e4f0f9a7f42967984b06a (DEFAULT_TABLE table=test-table [id=34679f853e0940e9b38413a3934859dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.176995 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.170642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.0.124.131:35399)
0929 22:57:16.170799 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.170803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.171281 (+ 478us) server_negotiation.cc:407] Connection header received
0929 22:57:16.171319 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.171321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.171335 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.171401 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.171561 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.172598 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.173846 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.174707 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.174771 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.174820 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.176877 (+ 2057us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.176918 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260929 22:57:16.177165 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e70309e59e4f0f9a7f42967984b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.177594 14736 tablet_service.cc:1467] Processing CreateTablet for tablet 02e70309e59e4f0f9a7f42967984b06a (DEFAULT_TABLE table=test-table [id=34679f853e0940e9b38413a3934859dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.177875 14736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e70309e59e4f0f9a7f42967984b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.178594 14819 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Bootstrap starting.
I20260929 22:57:16.179222 14819 tablet_bootstrap.cc:654] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.179839 14819 log.cc:824] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.180653 14819 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: No bootstrap required, opened a new log
I20260929 22:57:16.180711 14819 ts_tablet_manager.cc:1397] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:16.181257 14822 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Bootstrap starting.
I20260929 22:57:16.181895 14822 tablet_bootstrap.cc:654] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.182425 14822 log.cc:824] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.182837 14819 raft_consensus.cc:348] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.182996 14819 raft_consensus.cc:374] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.183041 14819 raft_consensus.cc:729] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bcaad7f93694087ac5ce85890df4676, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.183146 14819 consensus_queue.cc:260] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.183275 14822 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: No bootstrap required, opened a new log
I20260929 22:57:16.183351 14822 ts_tablet_manager.cc:1397] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:16.183413 14819 ts_tablet_manager.cc:1428] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:57:16.183604 14668 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
I20260929 22:57:16.180302 14821 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Bootstrap starting.
I20260929 22:57:16.184588 14821 tablet_bootstrap.cc:654] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.185158 14821 log.cc:824] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.185618 14822 raft_consensus.cc:348] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.185788 14822 raft_consensus.cc:374] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.185829 14822 raft_consensus.cc:729] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3522eb7a444b17aab3a5a14fb42eb4, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.185956 14822 consensus_queue.cc:260] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.186185 14821 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: No bootstrap required, opened a new log
I20260929 22:57:16.186239 14822 ts_tablet_manager.cc:1428] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:57:16.186311 14802 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
I20260929 22:57:16.186558 14821 ts_tablet_manager.cc:1397] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260929 22:57:16.188871 14821 raft_consensus.cc:348] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.189030 14821 raft_consensus.cc:374] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.189065 14821 raft_consensus.cc:729] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67c7591f86e4aed8beca9416ad105f1, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.189198 14821 consensus_queue.cc:260] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.189478 14821 ts_tablet_manager.cc:1428] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:57:16.189534 14534 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
W20260929 22:57:16.248260 14669 tablet.cc:2369] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:16.329540 14824 raft_consensus.cc:482] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:16.329654 14824 raft_consensus.cc:504] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.330036 14824 leader_election.cc:288] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:16.333981 14816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.330345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:38869 (local address 127.0.124.129:43111)
0929 22:57:16.330397 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.330399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.330488 (+ 89us) server_negotiation.cc:407] Connection header received
0929 22:57:16.330520 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.330521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.330528 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.330570 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.330730 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.331414 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333014 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.333592 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333666 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.333675 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.333871 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.333912 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:57:16.333986 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.330259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:47335 (local address 127.0.124.131:35399)
0929 22:57:16.330322 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.330324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.330333 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:16.330361 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.330362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.330373 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.330441 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.330659 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.331439 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333025 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.333587 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333667 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.333675 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.333872 (+ 197us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.333910 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:57:16.333992 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.330177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35399 (local address 127.0.124.130:47335)
0929 22:57:16.330221 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.330233 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.330280 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.330459 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.330460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.330462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.330575 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.330577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.331519 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.331521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.332916 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.332919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.333685 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.333791 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.333793 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.333849 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.333890 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":90}
I20260929 22:57:16.333998 14828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.330208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.124.130:38869)
0929 22:57:16.330383 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.330400 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.330466 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.330592 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.330592 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.330594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.330655 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.330656 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.331519 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.331521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.332928 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.332930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.333685 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.333686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.333783 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.333787 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.333855 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.333889 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":31,"thread_start_us":99,"threads_started":1}
W20260929 22:57:16.334280 14535 tablet.cc:2369] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:16.334369 14756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e70309e59e4f0f9a7f42967984b06a" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" is_pre_election: true
I20260929 22:57:16.334510 14756 raft_consensus.cc:2454] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 0.
I20260929 22:57:16.334482 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e70309e59e4f0f9a7f42967984b06a" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67c7591f86e4aed8beca9416ad105f1" is_pre_election: true
I20260929 22:57:16.334630 14481 raft_consensus.cc:2454] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 0.
I20260929 22:57:16.334740 14556 leader_election.cc:302] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4; no voters:
I20260929 22:57:16.334887 14824 raft_consensus.cc:2781] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:16.334940 14824 raft_consensus.cc:482] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:16.334962 14824 raft_consensus.cc:3037] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:16.335645 14824 raft_consensus.cc:504] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.335777 14824 leader_election.cc:288] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 election: Requested vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:16.335908 14756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e70309e59e4f0f9a7f42967984b06a" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
I20260929 22:57:16.335939 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e70309e59e4f0f9a7f42967984b06a" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67c7591f86e4aed8beca9416ad105f1"
I20260929 22:57:16.335997 14481 raft_consensus.cc:3037] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:16.335992 14756 raft_consensus.cc:3037] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:16.336926 14481 raft_consensus.cc:2454] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 1.
I20260929 22:57:16.336926 14756 raft_consensus.cc:2454] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 1.
I20260929 22:57:16.337101 14555 leader_election.cc:302] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcaad7f93694087ac5ce85890df4676, b67c7591f86e4aed8beca9416ad105f1; no voters:
I20260929 22:57:16.337211 14824 raft_consensus.cc:2781] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:16.337364 14824 raft_consensus.cc:686] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 1 LEADER]: Becoming Leader. State: Replica: 2bcaad7f93694087ac5ce85890df4676, State: Running, Role: LEADER
I20260929 22:57:16.337517 14824 consensus_queue.cc:237] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.338411 14342 catalog_manager.cc:5495] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130). New cstate: current_term: 1 leader_uuid: "2bcaad7f93694087ac5ce85890df4676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } health_report { overall_health: UNKNOWN } } }
I20260929 22:57:16.355571 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.353137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56276 (local address 127.0.124.130:39215)
0929 22:57:16.353203 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.353205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.353214 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:16.353305 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.353306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.353334 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.353412 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:16.353561 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.354022 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.354768 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.354964 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.355059 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.355229 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:16.355345 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:16.355436 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.355456 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.355476 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:57:16.357196 14756 raft_consensus.cc:1261] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Refusing update from remote peer 2bcaad7f93694087ac5ce85890df4676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:16.357214 14481 raft_consensus.cc:1261] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Refusing update from remote peer 2bcaad7f93694087ac5ce85890df4676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:16.357488 14829 consensus_queue.cc:1035] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:16.357626 14824 consensus_queue.cc:1035] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:16.360178 14832 mvcc.cc:205] Tried to move back new op lower bound from 7334799918516801536 to 7334799918439374848. Current Snapshot: MvccSnapshot[applied={T|T < 7334799918516801536}]
I20260929 22:57:16.360320 14834 mvcc.cc:205] Tried to move back new op lower bound from 7334799918516801536 to 7334799918439374848. Current Snapshot: MvccSnapshot[applied={T|T < 7334799918516801536 or (T in {7334799918516801536})}]
I20260929 22:57:16.360545 14833 mvcc.cc:205] Tried to move back new op lower bound from 7334799918516801536 to 7334799918439374848. Current Snapshot: MvccSnapshot[applied={T|T < 7334799918516801536}]
I20260929 22:57:16.362263 14343 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:16.362350 14343 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:16.363118 14343 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Sending DeleteTablet for 3 replicas of tablet 02e70309e59e4f0f9a7f42967984b06a
I20260929 22:57:16.363440 14602 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e70309e59e4f0f9a7f42967984b06a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:16 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:56272
I20260929 22:57:16.363449 14736 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e70309e59e4f0f9a7f42967984b06a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:16 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:54282
I20260929 22:57:16.363445 14468 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e70309e59e4f0f9a7f42967984b06a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:16 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:53040
I20260929 22:57:16.363643 14841 tablet_replica.cc:330] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: stopping tablet replica
I20260929 22:57:16.363749 14841 raft_consensus.cc:2229] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:57:16.363793 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14405
I20260929 22:57:16.363865 14841 raft_consensus.cc:2258] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:16.364365 14841 ts_tablet_manager.cc:1905] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:16.366398 14841 ts_tablet_manager.cc:1918] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:16.366458 14841 log.cc:1196] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/02e70309e59e4f0f9a7f42967984b06a
I20260929 22:57:16.366711 14841 ts_tablet_manager.cc:1939] T 02e70309e59e4f0f9a7f42967984b06a P 2bcaad7f93694087ac5ce85890df4676: Deleting consensus metadata
I20260929 22:57:16.367059 14328 catalog_manager.cc:4841] TS 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): tablet 02e70309e59e4f0f9a7f42967984b06a (table test-table [id=34679f853e0940e9b38413a3934859dd]) successfully deleted
I20260929 22:57:16.367487 14843 tablet_replica.cc:330] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: stopping tablet replica
I20260929 22:57:16.367600 14843 raft_consensus.cc:2229] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:16.367691 14843 raft_consensus.cc:2258] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:16.368132 14843 ts_tablet_manager.cc:1905] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:16.369657 14843 ts_tablet_manager.cc:1918] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:16.369742 14843 log.cc:1196] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/02e70309e59e4f0f9a7f42967984b06a
I20260929 22:57:16.370005 14843 ts_tablet_manager.cc:1939] T 02e70309e59e4f0f9a7f42967984b06a P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting consensus metadata
I20260929 22:57:16.370427 14328 catalog_manager.cc:4841] TS cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): tablet 02e70309e59e4f0f9a7f42967984b06a (table test-table [id=34679f853e0940e9b38413a3934859dd]) successfully deleted
W20260929 22:57:16.370913 14327 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:43111 (error 108)
I20260929 22:57:16.371084 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14539
I20260929 22:57:16.372738 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.371794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.0.1:53042)
0929 22:57:16.372655 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.372700 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:43111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":841}
W20260929 22:57:16.372874 14327 catalog_manager.cc:4584] TS b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 02e70309e59e4f0f9a7f42967984b06a: Network error: Client connection negotiation failed: client connection to 127.0.124.129:43111: connect: Connection refused (error 111)
I20260929 22:57:16.375972 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14673
I20260929 22:57:16.382944 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14311
I20260929 22:57:16.387743 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--webserver_interface=127.0.124.190
--webserver_port=46607
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:38277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:16.464605 14845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:16.464833 14845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:16.464869 14845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:16.466017 14845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:16.466078 14845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:16.466100 14845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:16.466118 14845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:16.466149 14845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:16.467533 14845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:38277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=46607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:16.467779 14845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:16.467990 14845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:16.476455 14851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.476454 14852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.476477 14854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:16.476500 14845 server_base.cc:1034] running on GCE node
I20260929 22:57:16.476969 14845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:16.477212 14845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:16.478340 14845 hybrid_clock.cc:648] HybridClock initialized: now 1790722636478331 us; error 25 us; skew 500 ppm
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:16.480891 14845 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:16.481356 14845 webserver.cc:460] Webserver started at http://127.0.124.190:46607/ using document root <none> and password file <none>
I20260929 22:57:16.481576 14845 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:16.481629 14845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:16.482894 14845 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:16.483596 14861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.483781 14845 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:16.483877 14845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "559d08f3effa44678d3875526ab8b399"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "0e8512b8f4363d911dc23490b3ff9b9e"
server_key_iv: "7fc889d54cf85e17e8a913c6f03112a6"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.484304 14845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:16.500321 14845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:16.502540 14845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:16.502718 14845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:16.506657 14845 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:38277
I20260929 22:57:16.506719 14913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:38277 every 8 connection(s)
I20260929 22:57:16.507081 14845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:16.508757 14914 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:57:16.509385 14914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap starting.
I20260929 22:57:16.512548 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14845
I20260929 22:57:16.512810 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:43111
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=33617
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:16.517728 14914 log.cc:824] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.519672 14914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:16.519966 14914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap complete.
I20260929 22:57:16.522284 14914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:16.522562 14914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.522742 14914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:16.522830 14914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:16.522884 14914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:16.522934 14914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:57:16.523962 14914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:16.524078 14914 leader_election.cc:302] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559d08f3effa44678d3875526ab8b399; no voters:
I20260929 22:57:16.524274 14914 leader_election.cc:288] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:57:16.524308 14918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:57:16.524430 14918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 LEADER]: Becoming Leader. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Running, Role: LEADER
I20260929 22:57:16.524514 14918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:16.524560 14914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:16.524755 14918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559d08f3effa44678d3875526ab8b399. Latest consensus state: current_term: 2 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:16.524827 14918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:16.524758 14919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:16.524863 14919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:16.525059 14922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:16.525846 14922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:16.525970 14922 catalog_manager.cc:1259] Loaded cluster ID: 24f95967a53744e098d32b0aabd70bfa
I20260929 22:57:16.526021 14922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:16.526258 14922 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260929 22:57:16.531522 14922 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260929 22:57:16.533895 14922 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:16.534075 14922 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Loaded TSK: 0
I20260929 22:57:16.534283 14922 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:57:16.597074 14916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:16.597259 14916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:16.597281 14916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:16.598420 14916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:16.598460 14916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:16.598489 14916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:16.599903 14916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:43111
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=33617
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:16.600148 14916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:16.600402 14916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:16.605288 14944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.605353 14942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.605280 14941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:16.605568 14916 server_base.cc:1034] running on GCE node
I20260929 22:57:16.605752 14916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:16.606014 14916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:16.607196 14916 hybrid_clock.cc:648] HybridClock initialized: now 1790722636607165 us; error 43 us; skew 500 ppm
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:16.610222 14916 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:16.610713 14916 webserver.cc:460] Webserver started at http://127.0.124.129:33617/ using document root <none> and password file <none>
I20260929 22:57:16.610966 14916 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:16.611039 14916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:16.612726 14916 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:57:16.613449 14951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.613641 14916 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:57:16.613759 14916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "b67c7591f86e4aed8beca9416ad105f1"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "5fea30213f2d217ccf7433ad906d2dc2"
server_key_iv: "ac3a3d202afe2f4d66c9908409136916"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.614076 14916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:16.633518 14916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:16.635710 14916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:16.635842 14916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:16.636070 14916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:16.636533 14958 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:57:16.638278 14916 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:57:16.638334 14916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:57:16.638375 14916 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:57:16.638952 14916 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:57:16.639015 14916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:57:16.639068 14958 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Bootstrap starting.
I20260929 22:57:16.645726 14916 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:43111
I20260929 22:57:16.645764 15065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:43111 every 8 connection(s)
I20260929 22:57:16.646106 14916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:16.647598 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 14916
I20260929 22:57:16.647851 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:39215
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=44677
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:16.649547 14958 log.cc:824] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.651707 14958 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:16.652041 14958 tablet_bootstrap.cc:492] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Bootstrap complete.
I20260929 22:57:16.653235 14958 ts_tablet_manager.cc:1397] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260929 22:57:16.654667 14958 raft_consensus.cc:348] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.655055 14958 raft_consensus.cc:729] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67c7591f86e4aed8beca9416ad105f1, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.655242 14958 consensus_queue.cc:260] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.655550 14958 ts_tablet_manager.cc:1428] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:16.662603 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.646946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:39717 (local address 127.0.124.190:38277)
0929 22:57:16.652647 (+ 5701us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.652656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.652694 (+ 38us) server_negotiation.cc:407] Connection header received
0929 22:57:16.652811 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.652816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.652866 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.653008 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.654027 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.655351 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.656511 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.656892 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.657007 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.659192 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.659195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.659195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.659205 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.660878 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.661355 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.661357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.661357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.661438 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.661698 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.661698 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.661699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.661909 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.661972 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.662342 (+ 370us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.662457 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5646,"thread_start_us":71,"threads_started":1}
I20260929 22:57:16.662623 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.646885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:39717)
0929 22:57:16.651702 (+ 4817us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.651743 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.652428 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.653246 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.653250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.653596 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:16.653882 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.653888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.655460 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.655461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.656422 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.656425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.656999 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.657000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.657115 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.657681 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.657690 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.659055 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.660963 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.660970 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.660972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.661267 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.661503 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.661504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.661504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.661623 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.661974 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.661979 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.662122 (+ 143us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.662230 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.662398 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4771,"thread_start_us":103,"threads_started":1}
I20260929 22:57:16.663296 15066 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:16.663383 15066 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:16.663592 15066 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:16.664295 14878 ts_manager.cc:194] Registered new tserver with Master: b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:16.665354 14878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:39717
I20260929 22:57:16.666169 15066 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.129@KRBTEST.COM
I20260929 22:57:16.673310 15074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.664940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53044 (local address 127.0.124.129:43111)
0929 22:57:16.665107 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.665111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.665288 (+ 177us) server_negotiation.cc:407] Connection header received
0929 22:57:16.665351 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.665353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.665370 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.665446 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.666047 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.666913 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.667994 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.668352 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.668409 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.670457 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.670464 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.670465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.670471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.672084 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.672515 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.672517 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.672517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.672569 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.672758 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.672759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.672759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.672928 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.673013 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.673174 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.673245 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
I20260929 22:57:16.673334 15073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.664861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.0.1:53044)
0929 22:57:16.665171 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.665207 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.665281 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.665517 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.665521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.665890 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:16.665940 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.665942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.666985 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.666986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.667900 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.667902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.668427 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.668428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.668504 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.668900 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.668905 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.670333 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.672166 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.672171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.672173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.672437 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.672637 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.672637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.672637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.672700 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.673002 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.673007 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.673056 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.673143 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.673245 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":100,"threads_started":1}
I20260929 22:57:16.674110 14984 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e70309e59e4f0f9a7f42967984b06a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:16 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:53044
I20260929 22:57:16.674639 15075 tablet_replica.cc:330] stopping tablet replica
I20260929 22:57:16.674763 15075 raft_consensus.cc:2229] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:16.674839 15075 raft_consensus.cc:2258] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:16.675127 15075 ts_tablet_manager.cc:1905] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:16.677223 15075 ts_tablet_manager.cc:1918] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:16.677301 15075 log.cc:1196] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/02e70309e59e4f0f9a7f42967984b06a
I20260929 22:57:16.677524 15075 ts_tablet_manager.cc:1939] T 02e70309e59e4f0f9a7f42967984b06a P b67c7591f86e4aed8beca9416ad105f1: Deleting consensus metadata
I20260929 22:57:16.677950 14862 catalog_manager.cc:4841] TS b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111): tablet 02e70309e59e4f0f9a7f42967984b06a (table test-table [id=34679f853e0940e9b38413a3934859dd]) successfully deleted
W20260929 22:57:16.732858 15070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:16.733075 15070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:16.733114 15070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:16.734246 15070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:16.734310 15070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:16.734355 15070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:16.735755 15070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:39215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=44677
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:16.736009 15070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:16.736248 15070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:16.741000 15081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.741003 15083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.741019 15080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:16.741169 15070 server_base.cc:1034] running on GCE node
I20260929 22:57:16.741381 15070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:16.741586 15070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:16.742717 15070 hybrid_clock.cc:648] HybridClock initialized: now 1790722636742698 us; error 36 us; skew 500 ppm
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:16.745172 15070 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:16.745628 15070 webserver.cc:460] Webserver started at http://127.0.124.130:44677/ using document root <none> and password file <none>
I20260929 22:57:16.745883 15070 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:16.745965 15070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:16.747210 15070 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:16.747738 15090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.747900 15070 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:16.747995 15070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "2bcaad7f93694087ac5ce85890df4676"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "f94bf7a5c371c4b8800543d71d75fad2"
server_key_iv: "0efffc3efc7afff0e698a20e94ab105e"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.748366 15070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:16.758250 15070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:16.760155 15070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:16.760308 15070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:16.760509 15070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:16.760767 15070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:16.760798 15070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.760818 15070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:16.760830 15070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.766367 15070 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39215
I20260929 22:57:16.766438 15203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39215 every 8 connection(s)
I20260929 22:57:16.766729 15070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:16.773111 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15070
I20260929 22:57:16.773402 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:35399
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=39003
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:16.775849 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.767333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:60667)
0929 22:57:16.767489 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.767529 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.767964 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.768159 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.768161 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.768740 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:16.768907 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.768911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.769538 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.769539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.770311 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.770313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.770645 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.770645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.770742 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.771231 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.771239 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.772572 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.774417 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.774423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.774425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.774714 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.774956 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.774956 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.774957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.775087 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.775402 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.775407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.775521 (+ 114us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.775599 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.775705 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260929 22:57:16.775858 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.767347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:60667 (local address 127.0.124.190:38277)
0929 22:57:16.767387 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.767389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.767617 (+ 228us) server_negotiation.cc:407] Connection header received
0929 22:57:16.768052 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.768053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.768061 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.768114 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.768979 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.769464 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.770382 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.770572 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.770627 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.772673 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.772675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.772676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.772685 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.774335 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.774815 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.774817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.774818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.774877 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.775171 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.775172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.775172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.775328 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.775408 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.775646 (+ 238us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.775740 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:57:16.776335 15204 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:16.776443 15204 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:16.776628 15204 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:16.777024 14878 ts_manager.cc:194] Registered new tserver with Master: 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
I20260929 22:57:16.777565 14878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:60667
W20260929 22:57:16.856794 15207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:16.856977 15207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:16.856998 15207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:16.858048 15207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:16.858083 15207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:16.858108 15207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:16.859551 15207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:35399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=39003
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:16.859727 15207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:16.859908 15207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:16.864648 15213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.864669 15215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:16.864669 15212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:16.864789 15207 server_base.cc:1034] running on GCE node
I20260929 22:57:16.864993 15207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:16.865267 15207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:16.866426 15207 hybrid_clock.cc:648] HybridClock initialized: now 1790722636866414 us; error 53 us; skew 500 ppm
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:16.868788 15207 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:16.869211 15207 webserver.cc:460] Webserver started at http://127.0.124.131:39003/ using document root <none> and password file <none>
I20260929 22:57:16.869387 15207 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:16.869436 15207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:16.870620 15207 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:16.871127 15222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.871290 15207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.871368 15207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
format_stamp: "Formatted at 2026-09-29 22:57:16 on dist-test-slave-512q"
server_key: "3c1f911a560e06dbea89f77152f8b87c"
server_key_iv: "1e627359a283bfba8682050d4d79dd94"
server_key_version: "encryptionkey@0"
I20260929 22:57:16.871654 15207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:16.880426 15207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:16.882570 15207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:16.882668 15207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:16.882812 15207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:16.883023 15207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:16.883052 15207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.883071 15207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:16.883083 15207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:16.888808 15207 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35399
I20260929 22:57:16.888896 15335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35399 every 8 connection(s)
I20260929 22:57:16.889221 15207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:57:16 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722636, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:16.897301 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.889924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:39237 (local address 127.0.124.190:38277)
0929 22:57:16.890004 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.890006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.890198 (+ 192us) server_negotiation.cc:407] Connection header received
0929 22:57:16.890617 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.890618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.890628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.890679 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.891491 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.891964 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.892926 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.893107 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.893157 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.895099 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.895101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.895101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.895107 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.896261 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.896596 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.896597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.896597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.896643 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.896838 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.896838 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.896838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.896927 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.896974 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.897177 (+ 203us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.897231 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 22:57:16.897454 15338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.889899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:39237)
0929 22:57:16.890073 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.890104 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.890537 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.890725 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.890729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.891243 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:16.891413 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.891417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.892038 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.892039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.892856 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.892858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.893176 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.893177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.893274 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.893729 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:16.893737 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:16.895018 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:16.896323 (+ 1305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.896328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.896330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.896535 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.896696 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:16.896697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:16.896697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:16.896787 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:16.896980 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:16.896983 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:16.897077 (+ 94us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.897151 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.897254 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":118,"threads_started":1}
I20260929 22:57:16.897927 15336 heartbeater.cc:347] Connected to a master server at 127.0.124.190:38277
I20260929 22:57:16.898026 15336 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:16.898185 15336 heartbeater.cc:511] Master 127.0.124.190:38277 requested a full tablet report, sending...
I20260929 22:57:16.898557 14878 ts_manager.cc:194] Registered new tserver with Master: cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399)
I20260929 22:57:16.898895 14878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:39237
I20260929 22:57:16.899116 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15207
I20260929 22:57:16.904824 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.899452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.0.124.190:38277)
0929 22:57:16.899507 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.899509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.899651 (+ 142us) server_negotiation.cc:407] Connection header received
0929 22:57:16.899706 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.899706 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.899714 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.899770 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:16.900371 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.900802 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.901474 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.901638 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.901684 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.902656 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:16.902657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:16.902657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:16.902663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:16.903922 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.904253 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.904254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.904255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.904311 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:16.904474 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:16.904474 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:16.904475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:16.904558 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:16.904663 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.904722 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.904773 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:57:16.905597 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:16.907810 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.905871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34096 (local address 127.0.124.190:38277)
0929 22:57:16.905900 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.905901 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.906009 (+ 108us) server_negotiation.cc:407] Connection header received
0929 22:57:16.906062 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.906063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.906085 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.906139 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:16.906209 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.906606 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.907293 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.907454 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.907500 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.907629 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:16.907700 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:16.907749 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.907761 (+ 12us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.907772 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260929 22:57:16.908048 14878 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:57:16.909670 14878 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:57:16.911510 14984 tablet_service.cc:1467] Processing CreateTablet for tablet a898ca0f12874813848072d20995ad16 (DEFAULT_TABLE table=test-table [id=fd38d76f0eef45acb6ebe462f60ffec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.911700 14984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a898ca0f12874813848072d20995ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.913271 14958 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Bootstrap starting.
I20260929 22:57:16.913681 14958 tablet_bootstrap.cc:654] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.914973 14958 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: No bootstrap required, opened a new log
I20260929 22:57:16.915031 14958 ts_tablet_manager.cc:1397] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:57:16.915052 15341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.911329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.0.124.131:35399)
0929 22:57:16.911497 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.911501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.911513 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:57:16.911550 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.911552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.911566 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.911793 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.911836 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.912823 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.914009 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.914660 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.914742 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.914795 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.914939 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.914976 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260929 22:57:16.915062 15073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.911269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35399 (local address 127.0.0.1:54292)
0929 22:57:16.911448 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.911456 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.911492 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.911680 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.911681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.911683 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.911721 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.911722 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.912934 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.912935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.913936 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.913939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.914754 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.914755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.914829 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.914848 (+ 19us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.914900 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.914998 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":49}
I20260929 22:57:16.915401 14958 raft_consensus.cc:348] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.915475 14958 raft_consensus.cc:374] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.915512 14958 raft_consensus.cc:729] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67c7591f86e4aed8beca9416ad105f1, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.915555 14958 consensus_queue.cc:260] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.915648 14958 ts_tablet_manager.cc:1428] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:57:16.915798 15270 tablet_service.cc:1467] Processing CreateTablet for tablet a898ca0f12874813848072d20995ad16 (DEFAULT_TABLE table=test-table [id=fd38d76f0eef45acb6ebe462f60ffec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.916105 15270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a898ca0f12874813848072d20995ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.917063 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.911368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39215 (local address 127.0.0.1:56290)
0929 22:57:16.911559 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:16.911566 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:16.911612 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:16.913699 (+ 2087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:16.913699 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:16.913701 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:16.913743 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.913745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.914825 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.914825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.915840 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:16.915843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.916834 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.916835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:16.916915 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.916918 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:16.916967 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:57:16.916995 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":48,"threads_started":1}
I20260929 22:57:16.917141 15343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:16.913372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56290 (local address 127.0.124.130:39215)
0929 22:57:16.913541 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:16.913545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:16.913555 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:57:16.913592 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:16.913598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:16.913610 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:16.913700 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:16.913799 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.914730 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.915980 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:16.916737 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:16.916818 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:16.916866 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:16.917001 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:57:16.917061 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260929 22:57:16.917740 15138 tablet_service.cc:1467] Processing CreateTablet for tablet a898ca0f12874813848072d20995ad16 (DEFAULT_TABLE table=test-table [id=fd38d76f0eef45acb6ebe462f60ffec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:16.918011 15138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a898ca0f12874813848072d20995ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:16.919111 15345 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Bootstrap starting.
I20260929 22:57:16.919806 15345 tablet_bootstrap.cc:654] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.920368 15345 log.cc:824] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.921025 15347 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Bootstrap starting.
I20260929 22:57:16.921060 15345 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: No bootstrap required, opened a new log
I20260929 22:57:16.921124 15345 ts_tablet_manager.cc:1397] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:16.921561 15347 tablet_bootstrap.cc:654] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:16.922010 15347 log.cc:824] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:16.922464 15345 raft_consensus.cc:348] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.922591 15345 raft_consensus.cc:374] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.922613 15345 raft_consensus.cc:729] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3522eb7a444b17aab3a5a14fb42eb4, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.922699 15347 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: No bootstrap required, opened a new log
I20260929 22:57:16.922765 15347 ts_tablet_manager.cc:1397] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:16.922760 15345 consensus_queue.cc:260] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.923072 15336 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
I20260929 22:57:16.924593 15347 raft_consensus.cc:348] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.924713 15347 raft_consensus.cc:374] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:16.924734 15347 raft_consensus.cc:729] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bcaad7f93694087ac5ce85890df4676, State: Initialized, Role: FOLLOWER
I20260929 22:57:16.924834 15347 consensus_queue.cc:260] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:16.925047 15347 ts_tablet_manager.cc:1428] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:16.925110 15204 heartbeater.cc:503] Master 127.0.124.190:38277 was elected leader, sending a full tablet report...
I20260929 22:57:16.923069 15345 ts_tablet_manager.cc:1428] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260929 22:57:17.017259 15205 tablet.cc:2369] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:17.069918 15350 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:17.070042 15350 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:17.070398 15350 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:17.073292 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.070599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.124.130:34279)
0929 22:57:17.070655 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.070668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:17.070711 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:17.070881 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:17.070882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:17.070883 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:17.070958 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:17.070959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.071624 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.071625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:17.072481 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:17.072484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.073059 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.073060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:17.073129 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:17.073131 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:57:17.073186 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:57:17.073223 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 22:57:17.073292 15074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.070683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:34279 (local address 127.0.124.129:43111)
0929 22:57:17.070736 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:17.070738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:17.070748 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:57:17.070777 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:17.070783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:17.070802 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:17.070877 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:17.071032 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.071534 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.072578 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.072981 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.073063 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:17.073138 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:17.073192 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:57:17.073231 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:57:17.073312 15341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.070661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:36731 (local address 127.0.124.131:35399)
0929 22:57:17.070721 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:17.070723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:17.070861 (+ 138us) server_negotiation.cc:407] Connection header received
0929 22:57:17.070940 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:17.070941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:17.070949 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:17.071017 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:17.071180 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.071633 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.072614 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.072963 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.073042 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:17.073052 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:17.073195 (+ 143us) server_negotiation.cc:299] Negotiation successful
0929 22:57:17.073236 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:57:17.073616 15351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.070616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35399 (local address 127.0.124.130:36731)
0929 22:57:17.070790 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.070799 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:17.070876 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:17.071031 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:17.071032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:17.071033 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:17.071107 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:17.071109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.071717 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.071718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:17.072525 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:17.072527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.073041 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.073042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:17.073115 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:17.073118 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:17.073187 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:57:17.073542 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
I20260929 22:57:17.073650 15020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a898ca0f12874813848072d20995ad16" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67c7591f86e4aed8beca9416ad105f1" is_pre_election: true
I20260929 22:57:17.073786 15020 raft_consensus.cc:2454] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 0.
I20260929 22:57:17.074015 15091 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcaad7f93694087ac5ce85890df4676, b67c7591f86e4aed8beca9416ad105f1; no voters:
I20260929 22:57:17.074015 15290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a898ca0f12874813848072d20995ad16" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" is_pre_election: true
I20260929 22:57:17.074146 15290 raft_consensus.cc:2454] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 0.
I20260929 22:57:17.074159 15350 raft_consensus.cc:2781] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:17.074223 15350 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:17.074278 15350 raft_consensus.cc:3037] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:17.074999 15350 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:17.075139 15350 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 election: Requested vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111)
I20260929 22:57:17.075309 15290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a898ca0f12874813848072d20995ad16" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
I20260929 22:57:17.075309 15020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a898ca0f12874813848072d20995ad16" candidate_uuid: "2bcaad7f93694087ac5ce85890df4676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67c7591f86e4aed8beca9416ad105f1"
I20260929 22:57:17.075381 15020 raft_consensus.cc:3037] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:17.075381 15290 raft_consensus.cc:3037] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:17.076195 15290 raft_consensus.cc:2454] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 1.
I20260929 22:57:17.076195 15020 raft_consensus.cc:2454] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcaad7f93694087ac5ce85890df4676 in term 1.
I20260929 22:57:17.076375 15092 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4; no voters:
I20260929 22:57:17.076468 15350 raft_consensus.cc:2781] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:17.076651 15350 raft_consensus.cc:686] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 1 LEADER]: Becoming Leader. State: Replica: 2bcaad7f93694087ac5ce85890df4676, State: Running, Role: LEADER
I20260929 22:57:17.076763 15350 consensus_queue.cc:237] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:17.077533 14877 catalog_manager.cc:5495] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130). New cstate: current_term: 1 leader_uuid: "2bcaad7f93694087ac5ce85890df4676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } health_report { overall_health: UNKNOWN } } }
I20260929 22:57:17.094738 15343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.092777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56300 (local address 127.0.124.130:39215)
0929 22:57:17.092822 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:17.092824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:17.092830 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:57:17.092874 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:17.092874 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:17.092888 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:17.092956 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:17.093045 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.093432 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.094139 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:17.094309 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:17.094357 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:17.094488 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:17.094573 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:17.094632 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:17.094661 (+ 29us) server_negotiation.cc:299] Negotiation successful
0929 22:57:17.094675 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:57:17.096354 15020 raft_consensus.cc:1261] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Refusing update from remote peer 2bcaad7f93694087ac5ce85890df4676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:17.096354 15290 raft_consensus.cc:1261] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Refusing update from remote peer 2bcaad7f93694087ac5ce85890df4676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:17.096662 15352 consensus_queue.cc:1035] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:17.096777 15350 consensus_queue.cc:1035] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:17.101533 14878 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:17.101625 14878 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:17.102313 14878 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Sending DeleteTablet for 3 replicas of tablet a898ca0f12874813848072d20995ad16
I20260929 22:57:17.102623 14984 tablet_service.cc:1514] Processing DeleteTablet for tablet a898ca0f12874813848072d20995ad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:17 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:53044
I20260929 22:57:17.102633 15138 tablet_service.cc:1514] Processing DeleteTablet for tablet a898ca0f12874813848072d20995ad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:17 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:56290
I20260929 22:57:17.102772 15270 tablet_service.cc:1514] Processing DeleteTablet for tablet a898ca0f12874813848072d20995ad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:17 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:54292
I20260929 22:57:17.102823 15364 tablet_replica.cc:330] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: stopping tablet replica
I20260929 22:57:17.102900 15364 raft_consensus.cc:2229] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:57:17.102941 15075 tablet_replica.cc:330] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: stopping tablet replica
I20260929 22:57:17.102988 15364 raft_consensus.cc:2258] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:17.102996 15075 raft_consensus.cc:2229] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:17.103055 15075 raft_consensus.cc:2258] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:17.103081 15365 tablet_replica.cc:330] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: stopping tablet replica
I20260929 22:57:17.103282 15365 raft_consensus.cc:2229] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:17.103361 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14916
I20260929 22:57:17.103413 15364 ts_tablet_manager.cc:1905] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:17.103502 15365 raft_consensus.cc:2258] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:17.105213 15364 ts_tablet_manager.cc:1918] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:17.105283 15364 log.cc:1196] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/a898ca0f12874813848072d20995ad16
I20260929 22:57:17.105571 15364 ts_tablet_manager.cc:1939] T a898ca0f12874813848072d20995ad16 P 2bcaad7f93694087ac5ce85890df4676: Deleting consensus metadata
I20260929 22:57:17.105954 14863 catalog_manager.cc:4841] TS 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): tablet a898ca0f12874813848072d20995ad16 (table test-table [id=fd38d76f0eef45acb6ebe462f60ffec7]) successfully deleted
I20260929 22:57:17.106046 15365 ts_tablet_manager.cc:1905] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:17.107580 15365 ts_tablet_manager.cc:1918] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:17.107649 15365 log.cc:1196] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/a898ca0f12874813848072d20995ad16
I20260929 22:57:17.107914 15365 ts_tablet_manager.cc:1939] T a898ca0f12874813848072d20995ad16 P cb3522eb7a444b17aab3a5a14fb42eb4: Deleting consensus metadata
I20260929 22:57:17.108315 14863 catalog_manager.cc:4841] TS cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): tablet a898ca0f12874813848072d20995ad16 (table test-table [id=fd38d76f0eef45acb6ebe462f60ffec7]) successfully deleted
W20260929 22:57:17.109153 14862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:43111 (error 108)
I20260929 22:57:17.109624 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15070
I20260929 22:57:17.109781 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.109626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:43111 (local address 127.0.0.1:53056)
0929 22:57:17.109693 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.109737 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:43111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260929 22:57:17.110468 14862 catalog_manager.cc:4584] TS b67c7591f86e4aed8beca9416ad105f1 (127.0.124.129:43111): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a898ca0f12874813848072d20995ad16: Network error: Client connection negotiation failed: client connection to 127.0.124.129:43111: connect: Connection refused (error 111)
I20260929 22:57:17.114661 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15207
I20260929 22:57:17.119647 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 14845
I20260929 22:57:17.124840 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--webserver_interface=127.0.124.190
--webserver_port=46607
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:38277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:17.204996 15367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:17.205196 15367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:17.205217 15367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:17.206282 15367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:17.206321 15367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:17.206333 15367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:17.206379 15367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:17.206396 15367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:17.207794 15367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:38277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:38277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=46607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:17.208004 15367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:17.208214 15367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:17.212903 15372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.212949 15375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.212909 15373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:17.213013 15367 server_base.cc:1034] running on GCE node
I20260929 22:57:17.213320 15367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:17.213603 15367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:17.214762 15367 hybrid_clock.cc:648] HybridClock initialized: now 1790722637214750 us; error 25 us; skew 500 ppm
Sep 29 22:57:17 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:17.217069 15367 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:17.217533 15367 webserver.cc:460] Webserver started at http://127.0.124.190:46607/ using document root <none> and password file <none>
I20260929 22:57:17.217741 15367 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:17.217805 15367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:17.219008 15367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:57:17.219632 15382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.219789 15367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:57:17.219885 15367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "559d08f3effa44678d3875526ab8b399"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "0e8512b8f4363d911dc23490b3ff9b9e"
server_key_iv: "7fc889d54cf85e17e8a913c6f03112a6"
server_key_version: "encryptionkey@0"
I20260929 22:57:17.220187 15367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:17.239102 15367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:17.241469 15367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:17.241626 15367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:17.245843 15367 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:38277
I20260929 22:57:17.245883 15434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:38277 every 8 connection(s)
I20260929 22:57:17.246219 15367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:17.247658 15435 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:57:17.248402 15435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap starting.
I20260929 22:57:17.249585 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15367
I20260929 22:57:17.249877 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:43111
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=33617
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:17.257207 15435 log.cc:824] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:17.259501 15435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:17.259786 15435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399: Bootstrap complete.
I20260929 22:57:17.262053 15435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:17.262292 15435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Initialized, Role: FOLLOWER
I20260929 22:57:17.262468 15435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:17.262542 15435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:17.262590 15435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:17.262636 15435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 2 FOLLOWER]: Advancing to term 3
I20260929 22:57:17.263636 15435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:17.263765 15435 leader_election.cc:302] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559d08f3effa44678d3875526ab8b399; no voters:
I20260929 22:57:17.263960 15435 leader_election.cc:288] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 22:57:17.264010 15439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 22:57:17.264120 15439 raft_consensus.cc:686] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [term 3 LEADER]: Becoming Leader. State: Replica: 559d08f3effa44678d3875526ab8b399, State: Running, Role: LEADER
I20260929 22:57:17.264235 15439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } }
I20260929 22:57:17.264263 15435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:17.264501 15440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:17.264590 15440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:17.264509 15441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559d08f3effa44678d3875526ab8b399. Latest consensus state: current_term: 3 leader_uuid: "559d08f3effa44678d3875526ab8b399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559d08f3effa44678d3875526ab8b399" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 38277 } } }
I20260929 22:57:17.264750 15441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559d08f3effa44678d3875526ab8b399 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:17.264883 15443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:17.265839 15443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:17.265991 15443 catalog_manager.cc:1259] Loaded cluster ID: 24f95967a53744e098d32b0aabd70bfa
I20260929 22:57:17.266192 15443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260929 22:57:17.266398 15443 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff6240b09ad google::LogMessage::Fail() at ??:0
@ 0x7ff6240b388a google::LogMessage::SendToLog() at ??:0
@ 0x7ff6240b04de google::LogMessage::Flush() at ??:0
@ 0x7ff6240b1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff62bfd10f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff62bfda8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff625f7e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff625f73954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff626dd76db start_thread at ??:0
@ 0x7ff622bae61f clone at ??:0
W20260929 22:57:17.360265 15437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:17.360522 15437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:17.360561 15437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:17.362213 15437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:17.362269 15437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:17.362308 15437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:17.364573 15437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:43111
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=33617
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:17.364817 15437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:17.365072 15437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:17.370340 15471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.370365 15474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.370311 15472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:17.371043 15437 server_base.cc:1034] running on GCE node
I20260929 22:57:17.371232 15437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:17.371483 15437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:17.372642 15437 hybrid_clock.cc:648] HybridClock initialized: now 1790722637372618 us; error 36 us; skew 500 ppm
Sep 29 22:57:17 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:17.375845 15437 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:17.376537 15437 webserver.cc:460] Webserver started at http://127.0.124.129:33617/ using document root <none> and password file <none>
I20260929 22:57:17.376804 15437 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:17.376873 15437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:17.378599 15437 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:17.379406 15481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.379652 15437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:17.379743 15437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "b67c7591f86e4aed8beca9416ad105f1"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "5fea30213f2d217ccf7433ad906d2dc2"
server_key_iv: "ac3a3d202afe2f4d66c9908409136916"
server_key_version: "encryptionkey@0"
I20260929 22:57:17.380159 15437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:17.408119 15437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:17.410771 15437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:17.410949 15437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:17.411239 15437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:17.411742 15488 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:57:17.413254 15437 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:57:17.413333 15437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:57:17.413372 15437 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:57:17.414301 15437 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:57:17.414350 15437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:57:17.414426 15488 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Bootstrap starting.
I20260929 22:57:17.422205 15437 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:43111
I20260929 22:57:17.422374 15595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:43111 every 8 connection(s)
I20260929 22:57:17.422680 15437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:17.424767 15488 log.cc:824] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:17.425874 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15437
I20260929 22:57:17.426121 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:39215
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=44677
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:17.427515 15488 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:17.427781 15488 tablet_bootstrap.cc:492] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Bootstrap complete.
I20260929 22:57:17.428726 15488 ts_tablet_manager.cc:1397] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.005s
I20260929 22:57:17.429670 15488 raft_consensus.cc:348] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:17.429900 15488 raft_consensus.cc:729] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67c7591f86e4aed8beca9416ad105f1, State: Initialized, Role: FOLLOWER
I20260929 22:57:17.430052 15488 consensus_queue.cc:260] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:17.430353 15488 ts_tablet_manager.cc:1428] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260929 22:57:17.478134 15598 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:57:17.423379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:34387)
0929 22:57:17.423604 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.423653 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:17.424324 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:17.477901 (+ 53577us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":110,"threads_started":1}
W20260929 22:57:17.478421 15596 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:38277 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:38277: Client connection negotiation failed: client connection to 127.0.124.190:38277: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:57:17.478809 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.478665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:47025)
0929 22:57:17.478740 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.478789 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:57:17.479192 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.479100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:55725)
0929 22:57:17.479149 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.479175 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260929 22:57:17.479318 15596 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:57:17.509486 15600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:17.509660 15600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:17.509680 15600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:17.510814 15600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:17.510855 15600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:17.510907 15600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:17.512494 15600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:39215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=44677
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:17.512720 15600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:17.512954 15600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:17.517905 15609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.517905 15607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.517974 15606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:17.518131 15600 server_base.cc:1034] running on GCE node
I20260929 22:57:17.518277 15600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:17.518450 15600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:17.519606 15600 hybrid_clock.cc:648] HybridClock initialized: now 1790722637519597 us; error 38 us; skew 500 ppm
Sep 29 22:57:17 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:17.521988 15600 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:17.522434 15600 webserver.cc:460] Webserver started at http://127.0.124.130:44677/ using document root <none> and password file <none>
I20260929 22:57:17.522668 15600 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:17.522742 15600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:17.524010 15600 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:57:17.524643 15616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.524804 15600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.524899 15600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "2bcaad7f93694087ac5ce85890df4676"
format_stamp: "Formatted at 2026-09-29 22:57:15 on dist-test-slave-512q"
server_key: "f94bf7a5c371c4b8800543d71d75fad2"
server_key_iv: "0efffc3efc7afff0e698a20e94ab105e"
server_key_version: "encryptionkey@0"
I20260929 22:57:17.525257 15600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:17.538810 15600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:17.540542 15600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:17.540686 15600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:17.540885 15600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:17.541170 15600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:17.541241 15600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.541281 15600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:17.541323 15600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.547158 15600 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39215
I20260929 22:57:17.547201 15729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39215 every 8 connection(s)
I20260929 22:57:17.547509 15600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:57:17.548503 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.548117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:42603)
0929 22:57:17.548307 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.548377 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":69,"threads_started":1}
W20260929 22:57:17.548880 15730 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:38277 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:38277: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
I20260929 22:57:17.549127 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.549042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:43499)
0929 22:57:17.549086 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.549111 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:57:17.549369 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.549302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:34255)
0929 22:57:17.549337 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.549357 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260929 22:57:17.549476 15730 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:57:17.552958 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15600
I20260929 22:57:17.553205 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:35399
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:38277
--webserver_port=39003
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:17.635902 15733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:17.636121 15733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:17.636164 15733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:17.637372 15733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:17.637413 15733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:17.637439 15733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:17.638851 15733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:35399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=39003
--tserver_master_addrs=127.0.124.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:17.639111 15733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:17.639339 15733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:17.644446 15738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:17.644631 15733 server_base.cc:1034] running on GCE node
W20260929 22:57:17.644548 15739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:17.644438 15741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:17.644949 15733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:17.645275 15733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:17.646431 15733 hybrid_clock.cc:648] HybridClock initialized: now 1790722637646412 us; error 33 us; skew 500 ppm
Sep 29 22:57:17 dist-test-slave-512q krb5kdc[14298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:17.649070 15733 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:17.649494 15733 webserver.cc:460] Webserver started at http://127.0.124.131:39003/ using document root <none> and password file <none>
I20260929 22:57:17.649748 15733 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:17.649816 15733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:17.651306 15733 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:17.651981 15748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.652298 15733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:17.652392 15733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "cb3522eb7a444b17aab3a5a14fb42eb4"
format_stamp: "Formatted at 2026-09-29 22:57:16 on dist-test-slave-512q"
server_key: "3c1f911a560e06dbea89f77152f8b87c"
server_key_iv: "1e627359a283bfba8682050d4d79dd94"
server_key_version: "encryptionkey@0"
I20260929 22:57:17.652729 15733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:17.673862 15733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:17.676184 15733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:17.676412 15733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:17.676680 15733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:17.677071 15733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:17.677125 15733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.677165 15733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:17.677194 15733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:17.684352 15733 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35399
I20260929 22:57:17.684389 15861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35399 every 8 connection(s)
I20260929 22:57:17.684752 15733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:17.685798 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.685392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:43251)
0929 22:57:17.685568 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.685643 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
W20260929 22:57:17.686165 15862 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:38277 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:38277: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
I20260929 22:57:17.686432 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.686337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:44489)
0929 22:57:17.686384 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.686407 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:57:17.686689 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:17.686609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:46451)
0929 22:57:17.686650 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:17.686672 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 22:57:17.686802 15862 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:57:17.691012 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15733
I20260929 22:57:18.479851 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.479650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:53215)
0929 22:57:18.479759 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:18.479791 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260929 22:57:18.549889 15867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.549720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:40863)
0929 22:57:18.549822 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:18.549847 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":56,"threads_started":1}
I20260929 22:57:18.687294 15868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.687097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:50489)
0929 22:57:18.687213 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:18.687247 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":52,"threads_started":1}
I20260929 22:57:18.959645 15869 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:18.959764 15869 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:18.960023 15869 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
Sep 29 22:57:18 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.130@KRBTEST.COM
Sep 29 22:57:18 dist-test-slave-512q krb5kdc[14298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.131@KRBTEST.COM
I20260929 22:57:18.972632 15871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.960363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39215 (local address 127.0.124.129:60459)
0929 22:57:18.960490 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:18.960500 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:18.960544 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:18.961452 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:18.961455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:18.961997 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:18.962283 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:18.962291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.963949 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.963949 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:18.965287 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:18.965290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.966122 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.966124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:18.966280 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:18.966893 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:18.966905 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:18.968903 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:18.970885 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:18.970892 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:18.970894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:18.971199 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:18.971495 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:18.971496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:18.971496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:18.971633 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:18.972067 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:18.972072 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:18.972181 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 22:57:18.972317 (+ 136us) client_negotiation.cc:240] Negotiation successful
0929 22:57:18.972488 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":88,"thread_start_us":54,"threads_started":1}
I20260929 22:57:18.972726 15872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.960451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:60459 (local address 127.0.124.130:39215)
0929 22:57:18.960599 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:18.960607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:18.960628 (+ 21us) server_negotiation.cc:407] Connection header received
0929 22:57:18.961161 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:18.961164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:18.961225 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:18.961379 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:18.962412 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.963834 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.965382 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.966013 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.966143 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:18.969051 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:18.969056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:18.969056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:18.969070 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:18.970795 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:18.971304 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:18.971307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:18.971307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:18.971438 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:18.971737 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:18.971738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:18.971739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:18.971989 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:18.972069 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:18.972442 (+ 373us) server_negotiation.cc:299] Negotiation successful
0929 22:57:18.972607 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":54,"threads_started":1}
I20260929 22:57:18.973201 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.960222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35399 (local address 127.0.124.129:50843)
0929 22:57:18.960289 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:18.960301 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:18.960370 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:18.961452 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:18.961455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:18.961997 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:18.962283 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:18.962291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.963947 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.963948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:18.965287 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:18.965290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.966124 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.966125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:18.966280 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:18.966929 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:18.966933 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:18.969273 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:18.971446 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:18.971447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:18.971448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:18.971646 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:18.972441 (+ 795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:18.972441 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:18.972442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:18.972514 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:18.972984 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:18.972985 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:18.973024 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:57:18.973075 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:57:18.973143 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":116}
I20260929 22:57:18.973459 15870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:18.960306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:50843 (local address 127.0.124.131:35399)
0929 22:57:18.960538 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:18.960552 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:18.960597 (+ 45us) server_negotiation.cc:407] Connection header received
0929 22:57:18.961174 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:18.961176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:18.961225 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:18.961379 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:18.962419 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.963834 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.965382 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:18.966013 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:18.966142 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:18.969381 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:18.969385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:18.969385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:18.969397 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:18.971359 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:18.972115 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:18.972118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:18.972118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:18.972355 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:18.972603 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:18.972604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:18.972605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:18.972916 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:18.973004 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:18.973140 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 22:57:18.973298 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":61,"threads_started":1}
W20260929 22:57:18.973902 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
W20260929 22:57:18.974176 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
I20260929 22:57:18.974210 15483 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67c7591f86e4aed8beca9416ad105f1; no voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4
I20260929 22:57:18.974301 15869 raft_consensus.cc:2726] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:57:19.480556 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:19.480335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:56683)
0929 22:57:19.480453 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:19.480506 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":56,"threads_started":1}
I20260929 22:57:19.550580 15874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:19.550331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:36625)
0929 22:57:19.550452 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:19.550504 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":104,"threads_started":1}
I20260929 22:57:19.687932 15875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:19.687727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:38715)
0929 22:57:19.687839 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:19.687874 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260929 22:57:20.481230 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:20.480969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:46657)
0929 22:57:20.481141 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:20.481174 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260929 22:57:20.551208 15877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:20.551014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:37935)
0929 22:57:20.551135 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:20.551171 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":57,"threads_started":1}
I20260929 22:57:20.688565 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:20.688348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:55161)
0929 22:57:20.688489 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:20.688525 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260929 22:57:21.051577 15879 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:21.051661 15879 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:21.051815 15879 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
W20260929 22:57:21.052290 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
W20260929 22:57:21.052381 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
I20260929 22:57:21.052438 15483 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67c7591f86e4aed8beca9416ad105f1; no voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4
I20260929 22:57:21.052531 15879 raft_consensus.cc:2726] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:57:21.481868 15880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:21.481663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:39707)
0929 22:57:21.481782 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:21.481822 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260929 22:57:21.552052 15881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:21.551814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:42877)
0929 22:57:21.551975 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:21.552015 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":71,"threads_started":1}
I20260929 22:57:21.689191 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:21.688974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:40383)
0929 22:57:21.689115 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:21.689153 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260929 22:57:22.482640 15883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:22.482425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:42727)
0929 22:57:22.482560 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:22.482594 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260929 22:57:22.552743 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:22.552519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:52549)
0929 22:57:22.552663 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:22.552700 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260929 22:57:22.689838 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:22.689626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:53825)
0929 22:57:22.689756 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:22.689795 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260929 22:57:23.125308 15886 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:23.125416 15886 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:23.125612 15886 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
W20260929 22:57:23.126013 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
W20260929 22:57:23.126093 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
I20260929 22:57:23.126117 15483 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67c7591f86e4aed8beca9416ad105f1; no voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4
I20260929 22:57:23.126185 15886 raft_consensus.cc:2726] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:57:23.483255 15887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:23.483056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:50663)
0929 22:57:23.483181 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:23.483212 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260929 22:57:23.553365 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:23.553154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:60433)
0929 22:57:23.553292 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:23.553329 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260929 22:57:23.690448 15889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:23.690229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:36487)
0929 22:57:23.690361 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:23.690400 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":55,"threads_started":1}
I20260929 22:57:24.483889 15890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:24.483711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:59399)
0929 22:57:24.483817 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:24.483846 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":54,"threads_started":1}
I20260929 22:57:24.553985 15891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:24.553799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:54839)
0929 22:57:24.553917 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:24.553951 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260929 22:57:24.691144 15892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:24.690905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:50451)
0929 22:57:24.691062 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:24.691101 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260929 22:57:25.484591 15893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:25.484368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:53381)
0929 22:57:25.484495 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:25.484537 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":58,"threads_started":1}
I20260929 22:57:25.554668 15894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:25.554438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:55191)
0929 22:57:25.554559 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:25.554608 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260929 22:57:25.691782 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:25.691561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:35145)
0929 22:57:25.691694 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:25.691742 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":53,"threads_started":1}
I20260929 22:57:26.485256 15896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:26.485014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:34817)
0929 22:57:26.485182 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:26.485211 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260929 22:57:26.555387 15897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:26.555149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:39819)
0929 22:57:26.555273 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:26.555335 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260929 22:57:26.692523 15898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:26.692310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:57151)
0929 22:57:26.692446 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:26.692478 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260929 22:57:27.439189 15899 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:27.439277 15899 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:27.439519 15899 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
W20260929 22:57:27.439917 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
W20260929 22:57:27.439986 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
I20260929 22:57:27.440001 15483 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67c7591f86e4aed8beca9416ad105f1; no voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4
I20260929 22:57:27.440086 15899 raft_consensus.cc:2726] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:57:27.485896 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:27.485710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:41881)
0929 22:57:27.485817 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:27.485853 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
I20260929 22:57:27.556103 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:27.555851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:50445)
0929 22:57:27.556008 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:27.556051 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
I20260929 22:57:27.693190 15902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:27.692961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:53203)
0929 22:57:27.693095 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:27.693135 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":55,"threads_started":1}
I20260929 22:57:28.486509 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:28.486311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:37619)
0929 22:57:28.486428 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:28.486464 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260929 22:57:28.556766 15904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:28.556570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:59045)
0929 22:57:28.556676 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:28.556710 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
I20260929 22:57:28.693842 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:28.693647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:46689)
0929 22:57:28.693764 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:28.693801 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260929 22:57:29.361812 15906 raft_consensus.cc:482] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:29.361901 15906 raft_consensus.cc:504] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb3522eb7a444b17aab3a5a14fb42eb4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35399 } } peers { permanent_uuid: "2bcaad7f93694087ac5ce85890df4676" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39215 } } peers { permanent_uuid: "b67c7591f86e4aed8beca9416ad105f1" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 43111 } }
I20260929 22:57:29.362084 15906 leader_election.cc:288] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399), 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215)
W20260929 22:57:29.362466 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb3522eb7a444b17aab3a5a14fb42eb4 (127.0.124.131:35399): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
W20260929 22:57:29.362588 15483 leader_election.cc:341] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bcaad7f93694087ac5ce85890df4676 (127.0.124.130:39215): Not found: Tablet not found: a898ca0f12874813848072d20995ad16
I20260929 22:57:29.362625 15483 leader_election.cc:302] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67c7591f86e4aed8beca9416ad105f1; no voters: 2bcaad7f93694087ac5ce85890df4676, cb3522eb7a444b17aab3a5a14fb42eb4
I20260929 22:57:29.362708 15906 raft_consensus.cc:2726] T a898ca0f12874813848072d20995ad16 P b67c7591f86e4aed8beca9416ad105f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:57:29.487145 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:29.486924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:52565)
0929 22:57:29.487063 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:29.487099 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260929 22:57:29.557367 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:29.557168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:37293)
0929 22:57:29.557295 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:29.557328 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260929 22:57:29.694408 15909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:29.694218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:42995)
0929 22:57:29.694334 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:29.694369 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260929 22:57:30.487725 15910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:30.487538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:58251)
0929 22:57:30.487649 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:30.487682 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260929 22:57:30.557960 15911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:30.557766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:44819)
0929 22:57:30.557886 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:30.557922 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":89,"threads_started":1}
I20260929 22:57:30.695222 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:30.694906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:48585)
0929 22:57:30.695075 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:30.695164 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":81,"threads_started":1}
I20260929 22:57:31.488423 15913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:31.488148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:33399)
0929 22:57:31.488299 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:31.488354 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260929 22:57:31.558578 15914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:31.558374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:35821)
0929 22:57:31.558502 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:31.558538 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260929 22:57:31.695847 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:31.695653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:35327)
0929 22:57:31.695772 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:31.695807 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
I20260929 22:57:32.489172 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:32.488957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.129:47783)
0929 22:57:32.489095 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:32.489128 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260929 22:57:32.559320 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:32.559048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.130:56291)
0929 22:57:32.559198 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:32.559252 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260929 22:57:32.696602 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:32.696417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:38277 (local address 127.0.124.131:56931)
0929 22:57:32.696527 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:32.696561 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:38277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260929 22:57:32.700793 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15437
I20260929 22:57:32.705360 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15600
I20260929 22:57:32.709681 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15733
2026-09-29T22:57:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18398 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:57:32 dist-test-slave-512q krb5kdc[15921](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:57:32 dist-test-slave-512q krb5kdc[15921](info): set up 2 sockets
Sep 29 22:57:32 dist-test-slave-512q krb5kdc[15921](info): commencing operation
krb5kdc: starting...
W20260929 22:57:33.734691 498 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.001s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:57:33 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:57:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:57:33.851279 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:45995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:33.929318 15934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:33.929560 15934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:33.929586 15934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:33.930748 15934 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:57:33.930787 15934 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:57:33.930800 15934 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:57:33.930811 15934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:33.930860 15934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:33.930879 15934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:33.930902 15934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:33.930926 15934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:33.932406 15934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:45995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:33.932657 15934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:33.932883 15934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:33.937901 15940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:33.937996 15934 server_base.cc:1034] running on GCE node
W20260929 22:57:33.937943 15939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:33.937913 15942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:33.938298 15934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:33.938544 15934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:33.939683 15934 hybrid_clock.cc:648] HybridClock initialized: now 1790722653939664 us; error 37 us; skew 500 ppm
Sep 29 22:57:33 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722653, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:33.942338 15934 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:33.942747 15934 webserver.cc:460] Webserver started at http://127.0.124.190:40293/ using document root <none> and password file <none>
I20260929 22:57:33.942937 15934 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:33.942991 15934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:33.943084 15934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:33.944118 15934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "87533f93249c4acab7088dd62b225d35"
format_stamp: "Formatted at 2026-09-29 22:57:33 on dist-test-slave-512q"
server_key: "4358e4a4d46fc8677664066af179ae3b"
server_key_iv: "9f4049a0945174d7dca944523c01cb7e"
server_key_version: "encryptionkey@0"
I20260929 22:57:33.944518 15934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "87533f93249c4acab7088dd62b225d35"
format_stamp: "Formatted at 2026-09-29 22:57:33 on dist-test-slave-512q"
server_key: "4358e4a4d46fc8677664066af179ae3b"
server_key_iv: "9f4049a0945174d7dca944523c01cb7e"
server_key_version: "encryptionkey@0"
I20260929 22:57:33.945931 15934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:33.946767 15949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:33.946928 15934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:33.947028 15934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "87533f93249c4acab7088dd62b225d35"
format_stamp: "Formatted at 2026-09-29 22:57:33 on dist-test-slave-512q"
server_key: "4358e4a4d46fc8677664066af179ae3b"
server_key_iv: "9f4049a0945174d7dca944523c01cb7e"
server_key_version: "encryptionkey@0"
I20260929 22:57:33.947099 15934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:33.966645 15934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:33.968662 15934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:33.968822 15934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:33.972582 15934 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:45995
I20260929 22:57:33.972615 16001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:45995 every 8 connection(s)
I20260929 22:57:33.972967 15934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:33.973860 16002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:33.975469 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 15934
I20260929 22:57:33.975587 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:57:33.975778 498 external_mini_cluster.cc:1428] Setting key 6972ce8efe45e24d5c4e2c40db538411
I20260929 22:57:33.977273 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap starting.
I20260929 22:57:33.977941 16002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:33.978250 16002 log.cc:824] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:33.978964 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: No bootstrap required, opened a new log
I20260929 22:57:33.981189 16002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:33.981369 16002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:33.981392 16002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Initialized, Role: FOLLOWER
I20260929 22:57:33.981511 16002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:33.981598 16002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:33.981621 16002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:33.981683 16002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:33.982198 16002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:33.982316 16002 leader_election.cc:302] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87533f93249c4acab7088dd62b225d35; no voters:
I20260929 22:57:33.982515 16002 leader_election.cc:288] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:57:33.982563 16007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:33.982746 16007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 LEADER]: Becoming Leader. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Running, Role: LEADER
I20260929 22:57:33.982796 16002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: configured and running, proceeding with master startup.
Sep 29 22:57:33 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:33.982925 16007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:33.983242 16007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87533f93249c4acab7088dd62b225d35. Latest consensus state: current_term: 1 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:57:33.983378 16007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:33.984058 16008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:57:33.984166 16008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:33.983664 16012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:33.984752 16012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:33.986143 16012 catalog_manager.cc:1347] Generated new cluster ID: 1ee6c76f6a1a4e1c95db9b08177899e5
I20260929 22:57:33.986191 16012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:33.987157 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:33.976297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37950 (local address 127.0.124.190:45995)
0929 22:57:33.976446 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:33.976455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:33.976487 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:57:33.976982 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:33.976991 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:33.977065 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:33.977216 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:33.977853 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:33.979148 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:33.979887 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:33.980564 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:33.980693 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:33.983434 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:33.983438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:33.983439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:33.983451 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:33.985530 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:33.985925 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:33.985928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:33.985928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:33.986040 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:33.986242 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:33.986243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:33.986243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:33.986517 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:33.986671 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:33.986808 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 22:57:33.986939 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260929 22:57:33.993232 16012 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:57:33.993692 16012 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:34.005631 16012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Generated new TSK 0
I20260929 22:57:34.005877 16012 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:57:34.042475 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:34.139767 16028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:34.140031 16028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:34.140072 16028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:34.141289 16028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:34.141357 16028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:34.141402 16028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:34.142800 16028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:34.143059 16028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:34.143282 16028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:34.148252 16033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:34.148245 16034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:34.148247 16036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:34.148715 16028 server_base.cc:1034] running on GCE node
I20260929 22:57:34.148942 16028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:34.149189 16028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:34.150352 16028 hybrid_clock.cc:648] HybridClock initialized: now 1790722654150336 us; error 43 us; skew 500 ppm
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:34.152915 16028 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:34.153352 16028 webserver.cc:460] Webserver started at http://127.0.124.129:41773/ using document root <none> and password file <none>
I20260929 22:57:34.153530 16028 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:34.153573 16028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:34.153676 16028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:34.154639 16028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "f80534dd9a9b1e928845d507c5852814"
server_key_iv: "19e6ef5eee5334981559f0e9165583ed"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.154935 16028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "f80534dd9a9b1e928845d507c5852814"
server_key_iv: "19e6ef5eee5334981559f0e9165583ed"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.156140 16028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:57:34.156868 16043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.157037 16028 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:34.157125 16028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "f80534dd9a9b1e928845d507c5852814"
server_key_iv: "19e6ef5eee5334981559f0e9165583ed"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.157179 16028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:34.178066 16028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:34.180413 16028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:34.180531 16028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:34.180856 16028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:34.181213 16028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:34.181278 16028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.181316 16028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:34.181345 16028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.186940 16028 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45115
I20260929 22:57:34.187053 16156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45115 every 8 connection(s)
I20260929 22:57:34.187356 16028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:34.187994 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16028
I20260929 22:57:34.188105 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:57:34.188377 498 external_mini_cluster.cc:1428] Setting key d22f1ef7b0b134b8a26fff2defaf023e
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
I20260929 22:57:34.197940 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.188278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:44619 (local address 127.0.124.190:45995)
0929 22:57:34.188355 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.188357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.188450 (+ 93us) server_negotiation.cc:407] Connection header received
0929 22:57:34.189116 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.189117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.189126 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.189163 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:34.190465 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.191301 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.192354 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.192716 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.192795 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.194948 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:34.194950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:34.194950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:34.194957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:34.196677 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.197060 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.197061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.197061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.197131 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.197369 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.197371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.197371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.197497 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:34.197562 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.197795 (+ 233us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.197870 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 22:57:34.198096 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.188122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:44619)
0929 22:57:34.188294 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.188347 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.189022 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.189255 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.189260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.190083 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:34.190376 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.190382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.191407 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.191408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.192270 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.192273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.192803 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.192804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.192949 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.193499 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:34.193508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:34.194858 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:34.196768 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.196774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.196776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.196984 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.197202 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.197203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.197203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.197300 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.197567 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:34.197572 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:34.197683 (+ 111us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.197766 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.197883 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260929 22:57:34.198657 16157 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:34.198772 16157 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:34.198953 16157 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:34.199536 15966 ts_manager.cc:194] Registered new tserver with Master: e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
I20260929 22:57:34.200331 15966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:44619
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:57:34.214259 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:34.294411 16162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:34.294636 16162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:34.294670 16162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:34.295799 16162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:34.295862 16162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:34.295907 16162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:34.297366 16162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:34.297627 16162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:34.297842 16162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:34.302729 16168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:34.302798 16162 server_base.cc:1034] running on GCE node
W20260929 22:57:34.302805 16167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:34.302740 16170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:34.303154 16162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:34.303406 16162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:34.304563 16162 hybrid_clock.cc:648] HybridClock initialized: now 1790722654304534 us; error 50 us; skew 500 ppm
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:34.307109 16162 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:34.307529 16162 webserver.cc:460] Webserver started at http://127.0.124.130:39747/ using document root <none> and password file <none>
I20260929 22:57:34.307749 16162 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:34.307813 16162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:34.307956 16162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:34.309013 16162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "deef186295fc461e8815062985e32036"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "5cf7c776ecd2bc26d771cb9578069dbb"
server_key_iv: "1fd61c3d5f282eab67438c2293fe9bab"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.309368 16162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "deef186295fc461e8815062985e32036"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "5cf7c776ecd2bc26d771cb9578069dbb"
server_key_iv: "1fd61c3d5f282eab67438c2293fe9bab"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.310657 16162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:57:34.311381 16177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.311553 16162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:57:34.311646 16162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "deef186295fc461e8815062985e32036"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "5cf7c776ecd2bc26d771cb9578069dbb"
server_key_iv: "1fd61c3d5f282eab67438c2293fe9bab"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.311725 16162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:34.334641 16162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:34.336515 16162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:34.336683 16162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:34.336894 16162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:34.337199 16162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:34.337257 16162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.337299 16162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:34.337325 16162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.342994 16162 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39973
I20260929 22:57:34.343034 16290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39973 every 8 connection(s)
I20260929 22:57:34.343364 16162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:57:34.348868 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16162
I20260929 22:57:34.348971 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:57:34.349175 498 external_mini_cluster.cc:1428] Setting key 76dded5cc6f8960cfd5be1bf522cb791
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:34.352867 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.344085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:49353 (local address 127.0.124.190:45995)
0929 22:57:34.344146 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.344148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.344362 (+ 214us) server_negotiation.cc:407] Connection header received
0929 22:57:34.344965 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.344967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.344981 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.345030 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:34.345972 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.346472 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.347472 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.347689 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.347760 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.350014 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:34.350015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:34.350016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:34.350022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:34.351503 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.351916 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.351918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.351918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.351982 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.352236 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.352237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.352237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.352352 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:34.352431 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.352696 (+ 265us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.352777 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:57:34.353050 16293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.344060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:49353)
0929 22:57:34.344226 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.344281 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.344844 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.345100 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.345103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.345673 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:34.345854 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.345858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.346590 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.346591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.347382 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.347384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.347778 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.347779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.347898 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.348340 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:34.348348 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:34.349928 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:34.351606 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.351613 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.351615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.351831 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.352050 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.352051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.352051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.352152 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.352421 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:34.352427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:34.352566 (+ 139us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.352675 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.352823 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260929 22:57:34.353518 16291 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:34.353622 16291 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:34.353787 16291 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:34.354151 15966 ts_manager.cc:194] Registered new tserver with Master: deef186295fc461e8815062985e32036 (127.0.124.130:39973)
I20260929 22:57:34.354667 15966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:49353
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:57:34.373239 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:34.458833 16296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:34.459067 16296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:34.459095 16296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:34.460518 16296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:34.460564 16296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:34.460623 16296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:34.462242 16296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:34.462508 16296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:34.462805 16296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:34.468122 16301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:34.468197 16302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:34.468178 16304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:34.468451 16296 server_base.cc:1034] running on GCE node
I20260929 22:57:34.468652 16296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:34.468881 16296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:34.470034 16296 hybrid_clock.cc:648] HybridClock initialized: now 1790722654470017 us; error 52 us; skew 500 ppm
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:34.472453 16296 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:34.472895 16296 webserver.cc:460] Webserver started at http://127.0.124.131:42491/ using document root <none> and password file <none>
I20260929 22:57:34.473132 16296 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:34.473203 16296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:34.473356 16296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:57:34.474346 16296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "236ccf762ac44711911f386603b1398a"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "295db93b88da63f88cd8cfe9cc098592"
server_key_iv: "0527c2b431b39a43a21d745d1e0f0a2c"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.474686 16296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "236ccf762ac44711911f386603b1398a"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "295db93b88da63f88cd8cfe9cc098592"
server_key_iv: "0527c2b431b39a43a21d745d1e0f0a2c"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.475952 16296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:57:34.476730 16311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.476902 16296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.477010 16296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "236ccf762ac44711911f386603b1398a"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "295db93b88da63f88cd8cfe9cc098592"
server_key_iv: "0527c2b431b39a43a21d745d1e0f0a2c"
server_key_version: "encryptionkey@0"
I20260929 22:57:34.477092 16296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:34.485200 16296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:34.487054 16296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:34.487205 16296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:34.487433 16296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:34.487660 16296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:34.487690 16296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.487709 16296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:34.487722 16296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:34.493356 16296 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:46855
I20260929 22:57:34.493402 16424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:46855 every 8 connection(s)
I20260929 22:57:34.493669 16296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:34.497566 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16296
I20260929 22:57:34.497663 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:57:34.497866 498 external_mini_cluster.cc:1428] Setting key 03779311a2f049d2a6f2e5c3e623afb8
Sep 29 22:57:34 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:34.502333 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.494309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:55527 (local address 127.0.124.190:45995)
0929 22:57:34.494369 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.494371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.494561 (+ 190us) server_negotiation.cc:407] Connection header received
0929 22:57:34.495003 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.495004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.495014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.495065 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:34.495899 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.496455 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.497374 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.497577 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.497649 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.499918 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:34.499919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:34.499919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:34.499925 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:34.501323 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.501652 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.501653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.501653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.501701 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.501894 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.501894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.501895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.501985 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:34.502034 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.502222 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.502276 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:57:34.502498 16427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.494294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:55527)
0929 22:57:34.494447 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.494477 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.494908 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.495113 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.495116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.495655 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:34.495826 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.495830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.496536 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.496537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.497303 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.497305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.497662 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.497663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.497819 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.498353 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:34.498360 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:34.499839 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:34.501387 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.501391 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.501393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.501590 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.501756 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:34.501757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:34.501757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:34.501843 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:34.502038 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:34.502042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:34.502137 (+ 95us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.502212 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.502314 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260929 22:57:34.502986 16425 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:34.503064 16425 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:34.503191 16425 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:34.503510 15966 ts_manager.cc:194] Registered new tserver with Master: 236ccf762ac44711911f386603b1398a (127.0.124.131:46855)
I20260929 22:57:34.503897 15966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:55527
I20260929 22:57:34.509557 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:34.516847 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.510946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37958 (local address 127.0.124.190:45995)
0929 22:57:34.511030 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.511032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.511123 (+ 91us) server_negotiation.cc:407] Connection header received
0929 22:57:34.511197 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.511197 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.511206 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.511272 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:34.511803 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.512331 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.513087 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.513277 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.513350 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.514484 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:34.514486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:34.514486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:34.514494 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:34.515661 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.516003 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.516004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.516004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.516068 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:34.516300 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:34.516301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:34.516301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:34.516441 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:34.516550 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.516669 (+ 119us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.516746 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 22:57:34.518287 15966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:57:34.519836 15966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:57:34.525796 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.521916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:46855 (local address 127.0.0.1:55672)
0929 22:57:34.522190 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.522201 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.522248 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.522508 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.522512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.522514 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:34.522579 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.522581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.523887 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.523888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.524818 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.524820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.525481 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.525482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.525561 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.525574 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.525674 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.525726 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":81,"thread_start_us":96,"threads_started":1}
I20260929 22:57:34.525807 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.521982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55672 (local address 127.0.124.131:46855)
0929 22:57:34.522355 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.522359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.522367 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:57:34.522394 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.522396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.522408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.522496 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:34.522666 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.523771 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.524929 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.525384 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.525479 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.525546 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.525690 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.525728 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":73,"threads_started":1}
I20260929 22:57:34.526329 16440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.522130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45115 (local address 127.0.0.1:57022)
0929 22:57:34.522402 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.522412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.522476 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.522647 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.522647 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.522650 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:34.522695 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.522696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.523674 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.523675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.524905 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.524907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.525850 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.525851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.526162 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.526167 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.526220 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.526260 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":39,"thread_start_us":67,"threads_started":1}
I20260929 22:57:34.526643 16441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.522241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.0.124.129:45115)
0929 22:57:34.522405 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.522410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.522456 (+ 46us) server_negotiation.cc:407] Connection header received
0929 22:57:34.522540 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.522542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.522556 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.522651 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:34.522796 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.523573 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.524991 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.525706 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.525770 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.525818 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.526520 (+ 702us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.526564 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260929 22:57:34.526571 16359 tablet_service.cc:1467] Processing CreateTablet for tablet 21b5438b53f7465c93274522cdd59cbb (DEFAULT_TABLE table=test-table [id=c873487ff2cb4156a9565956707632b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:34.526702 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.521916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39973 (local address 127.0.0.1:60368)
0929 22:57:34.522084 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.522124 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.522189 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.522804 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.522805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.522807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:34.522849 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.522851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.524085 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.524086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.525464 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.525466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.526484 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.526485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.526544 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.526547 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.526577 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.526609 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":54,"threads_started":1}
I20260929 22:57:34.526922 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b5438b53f7465c93274522cdd59cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:34.527307 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.522013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.0.124.130:39973)
0929 22:57:34.522636 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.522641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.522650 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:34.522687 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.522689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.522706 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.522920 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:34.522989 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.523987 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.525556 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.526388 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.527071 (+ 683us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.527133 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.527157 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.527222 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":71,"threads_started":1}
I20260929 22:57:34.527274 16091 tablet_service.cc:1467] Processing CreateTablet for tablet 21b5438b53f7465c93274522cdd59cbb (DEFAULT_TABLE table=test-table [id=c873487ff2cb4156a9565956707632b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:34.527614 16091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b5438b53f7465c93274522cdd59cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:34.527884 16225 tablet_service.cc:1467] Processing CreateTablet for tablet 21b5438b53f7465c93274522cdd59cbb (DEFAULT_TABLE table=test-table [id=c873487ff2cb4156a9565956707632b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:34.528185 16225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21b5438b53f7465c93274522cdd59cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:34.530138 16442 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap starting.
I20260929 22:57:34.530344 16443 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Bootstrap starting.
I20260929 22:57:34.530876 16442 tablet_bootstrap.cc:654] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:34.530930 16443 tablet_bootstrap.cc:654] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:34.531517 16443 log.cc:824] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:34.531636 16442 log.cc:824] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:34.531857 16444 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Bootstrap starting.
I20260929 22:57:34.532459 16442 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: No bootstrap required, opened a new log
I20260929 22:57:34.532527 16444 tablet_bootstrap.cc:654] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:34.532534 16442 ts_tablet_manager.cc:1397] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:57:34.532761 16443 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: No bootstrap required, opened a new log
I20260929 22:57:34.532841 16443 ts_tablet_manager.cc:1397] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:57:34.533066 16444 log.cc:824] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:34.533772 16444 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: No bootstrap required, opened a new log
I20260929 22:57:34.533841 16444 ts_tablet_manager.cc:1397] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:34.534497 16442 raft_consensus.cc:348] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.534677 16442 raft_consensus.cc:374] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:34.534720 16442 raft_consensus.cc:729] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc4b6f41db4b87a72ba9eab79b9b5c, State: Initialized, Role: FOLLOWER
I20260929 22:57:34.534829 16442 consensus_queue.cc:260] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.534795 16443 raft_consensus.cc:348] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.534956 16443 raft_consensus.cc:374] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:34.534996 16443 raft_consensus.cc:729] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 236ccf762ac44711911f386603b1398a, State: Initialized, Role: FOLLOWER
I20260929 22:57:34.535120 16442 ts_tablet_manager.cc:1428] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:57:34.535105 16443 consensus_queue.cc:260] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.535297 16157 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
I20260929 22:57:34.535357 16443 ts_tablet_manager.cc:1428] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:57:34.535481 16425 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
I20260929 22:57:34.535781 16444 raft_consensus.cc:348] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.535928 16444 raft_consensus.cc:374] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:34.535967 16444 raft_consensus.cc:729] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deef186295fc461e8815062985e32036, State: Initialized, Role: FOLLOWER
I20260929 22:57:34.536090 16444 consensus_queue.cc:260] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.536410 16444 ts_tablet_manager.cc:1428] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260929 22:57:34.536392 16291 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
I20260929 22:57:34.591354 16448 raft_consensus.cc:482] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:34.591478 16448 raft_consensus.cc:504] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.591909 16448 leader_election.cc:288] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deef186295fc461e8815062985e32036 (127.0.124.130:39973), 236ccf762ac44711911f386603b1398a (127.0.124.131:46855)
W20260929 22:57:34.593922 16292 tablet.cc:2369] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:34.595393 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.592113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39973 (local address 127.0.124.129:53237)
0929 22:57:34.592154 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.592166 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.592229 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.592390 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.592391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.592394 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:34.592472 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.592474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.593420 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.593420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.594562 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.594565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.595197 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.595198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.595259 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.595262 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.595305 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.595338 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 22:57:34.595440 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.592160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:53237 (local address 127.0.124.130:39973)
0929 22:57:34.592234 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.592237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.592264 (+ 27us) server_negotiation.cc:407] Connection header received
0929 22:57:34.592294 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.592295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.592310 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.592362 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:34.592558 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.593334 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.594655 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.595115 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.595193 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.595202 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.595327 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.595366 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:57:34.595847 16245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b5438b53f7465c93274522cdd59cbb" candidate_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deef186295fc461e8815062985e32036" is_pre_election: true
I20260929 22:57:34.595912 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.592260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:36945 (local address 127.0.124.131:46855)
0929 22:57:34.592317 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.592319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.592543 (+ 224us) server_negotiation.cc:407] Connection header received
0929 22:57:34.592572 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.592573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.592583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.592640 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:34.592763 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.593441 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.594981 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.595556 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.595630 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.595639 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.595831 (+ 192us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.595866 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:57:34.595918 16451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.592113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:46855 (local address 127.0.124.129:36945)
0929 22:57:34.592431 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.592443 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:34.592515 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:34.592647 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:34.592648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:34.592649 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:34.592698 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.592699 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.593521 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.593522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.594899 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:34.594901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.595671 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.595672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:34.595750 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.595754 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:34.595812 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:57:34.595847 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":159,"thread_start_us":104,"threads_started":1}
I20260929 22:57:34.596027 16245 raft_consensus.cc:2454] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc4b6f41db4b87a72ba9eab79b9b5c in term 0.
I20260929 22:57:34.596235 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b5438b53f7465c93274522cdd59cbb" candidate_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "236ccf762ac44711911f386603b1398a" is_pre_election: true
I20260929 22:57:34.596290 16045 leader_election.cc:302] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: deef186295fc461e8815062985e32036, e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters:
I20260929 22:57:34.596365 16379 raft_consensus.cc:2454] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc4b6f41db4b87a72ba9eab79b9b5c in term 0.
I20260929 22:57:34.596453 16448 raft_consensus.cc:2781] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:34.596545 16448 raft_consensus.cc:482] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:34.596576 16448 raft_consensus.cc:3037] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:34.597289 16448 raft_consensus.cc:504] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.597441 16448 leader_election.cc:288] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 1 election: Requested vote from peers deef186295fc461e8815062985e32036 (127.0.124.130:39973), 236ccf762ac44711911f386603b1398a (127.0.124.131:46855)
I20260929 22:57:34.597580 16245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b5438b53f7465c93274522cdd59cbb" candidate_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deef186295fc461e8815062985e32036"
I20260929 22:57:34.597594 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21b5438b53f7465c93274522cdd59cbb" candidate_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "236ccf762ac44711911f386603b1398a"
I20260929 22:57:34.597659 16245 raft_consensus.cc:3037] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:34.597659 16379 raft_consensus.cc:3037] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:34.598498 16379 raft_consensus.cc:2454] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc4b6f41db4b87a72ba9eab79b9b5c in term 1.
I20260929 22:57:34.598498 16245 raft_consensus.cc:2454] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc4b6f41db4b87a72ba9eab79b9b5c in term 1.
I20260929 22:57:34.598690 16045 leader_election.cc:302] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: deef186295fc461e8815062985e32036, e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters:
I20260929 22:57:34.598825 16448 raft_consensus.cc:2781] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:34.599030 16448 raft_consensus.cc:686] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 LEADER]: Becoming Leader. State: Replica: e8bc4b6f41db4b87a72ba9eab79b9b5c, State: Running, Role: LEADER
I20260929 22:57:34.599123 16448 consensus_queue.cc:237] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:34.599920 15966 catalog_manager.cc:5495] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129). New cstate: current_term: 1 leader_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } health_report { overall_health: HEALTHY } } }
I20260929 22:57:34.617121 16441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.614514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57038 (local address 127.0.124.129:45115)
0929 22:57:34.614578 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:34.614580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:34.614589 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:34.614621 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:34.614622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:34.614637 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:34.614711 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:34.614875 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.615557 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.616339 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:34.616552 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:34.616627 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:34.616796 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:34.616901 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:34.616997 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:34.617017 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 22:57:34.617037 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:57:34.618861 16379 raft_consensus.cc:1261] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Refusing update from remote peer e8bc4b6f41db4b87a72ba9eab79b9b5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:34.618891 16245 raft_consensus.cc:1261] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Refusing update from remote peer e8bc4b6f41db4b87a72ba9eab79b9b5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:34.619195 16448 consensus_queue.cc:1035] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:34.619352 16452 consensus_queue.cc:1035] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:34.621402 16455 mvcc.cc:205] Tried to move back new op lower bound from 7334799993315950592 to 7334799993238712320. Current Snapshot: MvccSnapshot[applied={T|T < 7334799993315950592}]
I20260929 22:57:34.622476 16456 mvcc.cc:205] Tried to move back new op lower bound from 7334799993315950592 to 7334799993238712320. Current Snapshot: MvccSnapshot[applied={T|T < 7334799993315950592}]
I20260929 22:57:34.623724 15965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:34.623821 15965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:34.624585 15965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Sending DeleteTablet for 3 replicas of tablet 21b5438b53f7465c93274522cdd59cbb
I20260929 22:57:34.624917 16225 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b5438b53f7465c93274522cdd59cbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:34 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60368
I20260929 22:57:34.624966 16359 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b5438b53f7465c93274522cdd59cbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:34 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:55672
I20260929 22:57:34.625003 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16028
I20260929 22:57:34.625028 16091 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b5438b53f7465c93274522cdd59cbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:34 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:57022
I20260929 22:57:34.625957 16466 tablet_replica.cc:330] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: stopping tablet replica
I20260929 22:57:34.626081 16466 raft_consensus.cc:2229] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:34.626186 16466 raft_consensus.cc:2258] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:34.626340 16465 tablet_replica.cc:330] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: stopping tablet replica
I20260929 22:57:34.626441 16465 raft_consensus.cc:2229] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:34.626537 16465 raft_consensus.cc:2258] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:34.626799 16466 ts_tablet_manager.cc:1905] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:34.626919 16465 ts_tablet_manager.cc:1905] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:34.628824 16465 ts_tablet_manager.cc:1918] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:34.628824 16466 ts_tablet_manager.cc:1918] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:34.628918 16466 log.cc:1196] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/21b5438b53f7465c93274522cdd59cbb
I20260929 22:57:34.628932 16465 log.cc:1196] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/21b5438b53f7465c93274522cdd59cbb
I20260929 22:57:34.629276 16465 ts_tablet_manager.cc:1939] T 21b5438b53f7465c93274522cdd59cbb P deef186295fc461e8815062985e32036: Deleting consensus metadata
I20260929 22:57:34.629276 16466 ts_tablet_manager.cc:1939] T 21b5438b53f7465c93274522cdd59cbb P 236ccf762ac44711911f386603b1398a: Deleting consensus metadata
I20260929 22:57:34.629755 15951 catalog_manager.cc:4841] TS deef186295fc461e8815062985e32036 (127.0.124.130:39973): tablet 21b5438b53f7465c93274522cdd59cbb (table test-table [id=c873487ff2cb4156a9565956707632b3]) successfully deleted
I20260929 22:57:34.629815 15952 catalog_manager.cc:4841] TS 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): tablet 21b5438b53f7465c93274522cdd59cbb (table test-table [id=c873487ff2cb4156a9565956707632b3]) successfully deleted
W20260929 22:57:34.630484 15951 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:45115 (error 108)
I20260929 22:57:34.630761 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16162
I20260929 22:57:34.631377 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:34.630887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45115 (local address 127.0.0.1:57046)
0929 22:57:34.631291 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:34.631334 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384}
W20260929 22:57:34.631531 15951 catalog_manager.cc:4584] TS e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21b5438b53f7465c93274522cdd59cbb: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45115: connect: Connection refused (error 111)
I20260929 22:57:34.635701 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16296
I20260929 22:57:34.640652 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 15934
I20260929 22:57:54.645828 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--webserver_interface=127.0.124.190
--webserver_port=40293
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:45995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:57:54.725844 16468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:54.726083 16468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:54.726130 16468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:54.727248 16468 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:57:54.727320 16468 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:57:54.727344 16468 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:57:54.727363 16468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:57:54.727392 16468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:54.727422 16468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:54.727450 16468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:57:54.727478 16468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:57:54.729102 16468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:45995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:54.729386 16468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:54.729615 16468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:54.738847 16475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:54.738878 16477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:54.738902 16468 server_base.cc:1034] running on GCE node
W20260929 22:57:54.738859 16474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:54.739406 16468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:54.739715 16468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:54.740852 16468 hybrid_clock.cc:648] HybridClock initialized: now 1790722674740834 us; error 40 us; skew 500 ppm
Sep 29 22:57:54 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722674, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:54.743393 16468 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:57:54.743834 16468 webserver.cc:460] Webserver started at http://127.0.124.190:40293/ using document root <none> and password file <none>
I20260929 22:57:54.744081 16468 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:54.744135 16468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:54.745621 16468 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:57:54.746311 16484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:54.746496 16468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:57:54.746567 16468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "87533f93249c4acab7088dd62b225d35"
format_stamp: "Formatted at 2026-09-29 22:57:33 on dist-test-slave-512q"
server_key: "4358e4a4d46fc8677664066af179ae3b"
server_key_iv: "9f4049a0945174d7dca944523c01cb7e"
server_key_version: "encryptionkey@0"
I20260929 22:57:54.746953 16468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:54.764410 16468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:54.766348 16468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:54.766520 16468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:54.770676 16468 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:45995
I20260929 22:57:54.770727 16536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:45995 every 8 connection(s)
I20260929 22:57:54.771183 16468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:57:54.772655 16537 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:57:54.773260 16537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap starting.
I20260929 22:57:54.781280 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16468
I20260929 22:57:54.781635 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:45115
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=41773
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:54.782020 16537 log.cc:824] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:54.784049 16537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:54.784395 16537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap complete.
I20260929 22:57:54.786682 16537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:54.786926 16537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Initialized, Role: FOLLOWER
I20260929 22:57:54.787099 16537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:54.787185 16537 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:57:54.787264 16537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:57:54.787315 16537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:57:54.788422 16537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:54.788516 16537 leader_election.cc:302] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87533f93249c4acab7088dd62b225d35; no voters:
I20260929 22:57:54.788738 16537 leader_election.cc:288] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:57:54.788774 16541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:57:54.788888 16541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 LEADER]: Becoming Leader. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Running, Role: LEADER
I20260929 22:57:54.789011 16537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:57:54.788985 16541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:57:54.789429 16542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:57:54.789525 16542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:54.789453 16543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87533f93249c4acab7088dd62b225d35. Latest consensus state: current_term: 2 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:57:54.789705 16543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:57:54.789750 16549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:57:54.790575 16549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:57:54.790675 16549 catalog_manager.cc:1259] Loaded cluster ID: 1ee6c76f6a1a4e1c95db9b08177899e5
I20260929 22:57:54.790704 16549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:57:54.791821 16549 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:57:54.792007 16549 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Loaded TSK: 0
I20260929 22:57:54.801105 16549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Generated new TSK 1
I20260929 22:57:54.801189 16549 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:57:54.865350 16540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:54.865581 16540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:54.865621 16540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:54.866830 16540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:54.866895 16540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:54.866945 16540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:57:54.868492 16540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:45115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=41773
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:54.868741 16540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:54.868970 16540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:54.874969 16564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:54.874917 16565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:54.874954 16567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:54.875545 16540 server_base.cc:1034] running on GCE node
I20260929 22:57:54.875756 16540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:54.876003 16540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:54.877202 16540 hybrid_clock.cc:648] HybridClock initialized: now 1790722674877159 us; error 59 us; skew 500 ppm
Sep 29 22:57:54 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722674, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:54.880021 16540 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:57:54.880618 16540 webserver.cc:460] Webserver started at http://127.0.124.129:41773/ using document root <none> and password file <none>
I20260929 22:57:54.880949 16540 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:54.881037 16540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:54.882812 16540 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:57:54.883710 16574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:54.883917 16540 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:54.884004 16540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "f80534dd9a9b1e928845d507c5852814"
server_key_iv: "19e6ef5eee5334981559f0e9165583ed"
server_key_version: "encryptionkey@0"
I20260929 22:57:54.884476 16540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:54.897056 16540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:54.899536 16540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:54.899699 16540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:54.899955 16540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:54.900497 16581 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:57:54.902325 16540 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:57:54.902392 16540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:57:54.902436 16540 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:57:54.903052 16540 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:57:54.903111 16540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:57:54.903184 16581 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap starting.
I20260929 22:57:54.910315 16540 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45115
I20260929 22:57:54.910356 16688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45115 every 8 connection(s)
I20260929 22:57:54.910755 16540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:57:54.913854 16581 log.cc:824] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:54.916350 16581 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:57:54.916627 16581 tablet_bootstrap.cc:492] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap complete.
I20260929 22:57:54.917088 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16540
I20260929 22:57:54.917440 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:39973
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=39747
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:57:54.918236 16581 ts_tablet_manager.cc:1397] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
Sep 29 22:57:54 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722674, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:54.921003 16581 raft_consensus.cc:348] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:54.921391 16581 raft_consensus.cc:729] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc4b6f41db4b87a72ba9eab79b9b5c, State: Initialized, Role: FOLLOWER
I20260929 22:57:54.921552 16581 consensus_queue.cc:260] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:54.921846 16581 ts_tablet_manager.cc:1428] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260929 22:57:54.923429 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:54.911630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:58639 (local address 127.0.124.190:45995)
0929 22:57:54.913033 (+ 1403us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:54.913039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:54.913065 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:57:54.913158 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:54.913162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:54.913198 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:54.913338 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:54.913983 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.915077 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.916079 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.916628 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.916753 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:54.919704 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:54.919708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:54.919709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:54.919720 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:54.921615 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:54.922112 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:54.922114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:54.922115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:54.922193 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:54.922492 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:54.922499 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:54.922499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:54.922703 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:54.922762 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:54.923198 (+ 436us) server_negotiation.cc:299] Negotiation successful
0929 22:57:54.923297 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1358,"thread_start_us":72,"threads_started":1}
I20260929 22:57:54.923586 16691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:54.911549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:58639)
0929 22:57:54.912398 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:54.912434 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:54.912879 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:54.913363 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:54.913367 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:54.913643 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:54.913822 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:54.913826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.915216 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.915217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:54.915977 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:54.915979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.916770 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.916771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:54.916936 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:54.917760 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:54.917769 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:54.919578 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:54.921735 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:54.921741 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:54.921743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:54.922033 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:54.922278 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:54.922279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:54.922280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:54.922414 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:54.922780 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:54.922786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:54.923002 (+ 216us) client_negotiation.cc:769] Sending connection context
0929 22:57:54.923150 (+ 148us) client_negotiation.cc:240] Negotiation successful
0929 22:57:54.923353 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":90,"threads_started":1}
I20260929 22:57:54.924293 16689 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:54.924408 16689 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:54.924574 16689 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:54.925349 16501 ts_manager.cc:194] Registered new tserver with Master: e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115)
I20260929 22:57:54.926456 16501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:58639
I20260929 22:57:54.927557 16689 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
I20260929 22:57:54.932754 16696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:54.925940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45115 (local address 127.0.0.1:58094)
0929 22:57:54.928312 (+ 2372us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:54.928348 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:54.928409 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:54.928687 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:54.928691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:54.928694 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:54.928762 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:54.928764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.930091 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.930092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:54.931546 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:54.931549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.932418 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.932419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:54.932514 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:54.932529 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:57:54.932613 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:57:54.932671 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2343,"thread_start_us":88,"threads_started":1}
I20260929 22:57:54.932758 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:54.926188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.0.124.129:45115)
0929 22:57:54.928546 (+ 2358us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:54.928550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:54.928559 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:57:54.928588 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:54.928589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:54.928604 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:54.928669 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:54.928851 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.929991 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.931653 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:54.932329 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:54.932399 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:54.932447 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:54.932640 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 22:57:54.932676 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2310,"thread_start_us":84,"threads_started":1}
I20260929 22:57:54.933444 16623 tablet_service.cc:1514] Processing DeleteTablet for tablet 21b5438b53f7465c93274522cdd59cbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:34 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:58094
I20260929 22:57:54.934055 16698 tablet_replica.cc:330] stopping tablet replica
I20260929 22:57:54.934171 16698 raft_consensus.cc:2229] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:54.934242 16698 raft_consensus.cc:2258] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:54.934561 16698 ts_tablet_manager.cc:1905] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:54.936918 16698 ts_tablet_manager.cc:1918] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:54.937024 16698 log.cc:1196] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal/wals/21b5438b53f7465c93274522cdd59cbb
I20260929 22:57:54.937268 16698 ts_tablet_manager.cc:1939] T 21b5438b53f7465c93274522cdd59cbb P e8bc4b6f41db4b87a72ba9eab79b9b5c: Deleting consensus metadata
I20260929 22:57:54.937765 16486 catalog_manager.cc:4841] TS e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115): tablet 21b5438b53f7465c93274522cdd59cbb (table test-table [id=c873487ff2cb4156a9565956707632b3]) successfully deleted
W20260929 22:57:55.004505 16694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:55.004689 16694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:55.004710 16694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:55.005772 16694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:55.005807 16694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:55.005832 16694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:57:55.007175 16694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:39973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=39747
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:55.007370 16694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:55.007542 16694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:55.012517 16704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:55.012517 16703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:55.012543 16706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:55.013034 16694 server_base.cc:1034] running on GCE node
I20260929 22:57:55.013235 16694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:55.013424 16694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:55.014607 16694 hybrid_clock.cc:648] HybridClock initialized: now 1790722675014604 us; error 39 us; skew 500 ppm
Sep 29 22:57:55 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:55.017154 16694 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:57:55.017678 16694 webserver.cc:460] Webserver started at http://127.0.124.130:39747/ using document root <none> and password file <none>
I20260929 22:57:55.017920 16694 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:55.018008 16694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:55.019338 16694 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:55.019971 16713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.020149 16694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:55.020275 16694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "deef186295fc461e8815062985e32036"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "5cf7c776ecd2bc26d771cb9578069dbb"
server_key_iv: "1fd61c3d5f282eab67438c2293fe9bab"
server_key_version: "encryptionkey@0"
I20260929 22:57:55.020625 16694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:55.038650 16694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:55.041069 16694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:55.041234 16694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:55.041461 16694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:55.041787 16694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:55.041853 16694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.041893 16694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:55.041919 16694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.047629 16694 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39973
I20260929 22:57:55.047672 16826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39973 every 8 connection(s)
I20260929 22:57:55.048034 16694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:57:55.053725 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16694
I20260929 22:57:55.054010 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:46855
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=42491
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:57:55 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:55.058457 16829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.048788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:40079)
0929 22:57:55.049045 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.049091 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.049652 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.050000 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.050004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.050584 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:55.050775 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.050780 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.051528 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.051529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.052361 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.052363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.052868 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.052869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.053002 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.053423 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:55.053431 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:55.054949 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:55.057041 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:55.057046 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:55.057048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:55.057257 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:55.057524 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:55.057525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:55.057525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:55.057653 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:55.057998 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:55.058003 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:55.058113 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.058195 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.058307 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":105,"threads_started":1}
I20260929 22:57:55.058497 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.048869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:40079 (local address 127.0.124.190:45995)
0929 22:57:55.049015 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.049018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.049191 (+ 173us) server_negotiation.cc:407] Connection header received
0929 22:57:55.049798 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.049799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.049817 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.049879 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:55.050896 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.051416 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.052471 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.052718 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.052839 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.055072 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:55.055073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:55.055073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:55.055082 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:55.056956 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.057345 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.057346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.057347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.057421 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.057742 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.057743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.057744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.057919 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:55.058008 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.058251 (+ 243us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.058356 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260929 22:57:55.059103 16827 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:55.059187 16827 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:55.059379 16827 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:55.059808 16501 ts_manager.cc:194] Registered new tserver with Master: deef186295fc461e8815062985e32036 (127.0.124.130:39973)
I20260929 22:57:55.060390 16501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:40079
W20260929 22:57:55.136799 16830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:57:55.136979 16830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:57:55.137001 16830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:57:55.138054 16830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:57:55.138087 16830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:57:55.138113 16830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:57:55.139439 16830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:46855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=42491
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:57:55.139603 16830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:57:55.139760 16830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:57:55.144465 16836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:57:55.144470 16838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:55.144626 16830 server_base.cc:1034] running on GCE node
W20260929 22:57:55.144482 16835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:57:55.144877 16830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:57:55.145062 16830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:57:55.146194 16830 hybrid_clock.cc:648] HybridClock initialized: now 1790722675146182 us; error 27 us; skew 500 ppm
Sep 29 22:57:55 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:57:55.148618 16830 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:57:55.149044 16830 webserver.cc:460] Webserver started at http://127.0.124.131:42491/ using document root <none> and password file <none>
I20260929 22:57:55.149209 16830 fs_manager.cc:359] Metadata directory not provided
I20260929 22:57:55.149257 16830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:57:55.150782 16830 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:57:55.151299 16845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.151525 16830 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.151593 16830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "236ccf762ac44711911f386603b1398a"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "295db93b88da63f88cd8cfe9cc098592"
server_key_iv: "0527c2b431b39a43a21d745d1e0f0a2c"
server_key_version: "encryptionkey@0"
I20260929 22:57:55.151868 16830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:57:55.175766 16830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:57:55.178097 16830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:57:55.178205 16830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:57:55.178375 16830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:57:55.178718 16830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:57:55.178751 16830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.178802 16830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:57:55.178830 16830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:57:55.184808 16830 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:46855
I20260929 22:57:55.184857 16958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:46855 every 8 connection(s)
I20260929 22:57:55.185205 16830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:57:55.189431 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16830
Sep 29 22:57:55 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:57:55.196570 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.185958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44171 (local address 127.0.124.190:45995)
0929 22:57:55.186054 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.186056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.186222 (+ 166us) server_negotiation.cc:407] Connection header received
0929 22:57:55.186953 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.186954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.186965 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.187025 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:55.188126 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.188817 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.190328 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.190566 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.190618 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.192991 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:55.192993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:55.192993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:55.193002 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:55.194771 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.195360 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.195361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.195361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.195419 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.195766 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.195767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.195767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.195901 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:55.195988 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.196363 (+ 375us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.196490 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:57:55.196769 16961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.185915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:44171)
0929 22:57:55.186093 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.186140 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.186782 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.187099 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.187102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.187850 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:57:55.188037 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.188042 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.188923 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.188924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.190242 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.190244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.190650 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.190651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.190851 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.191396 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:57:55.191404 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:57:55.192865 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:57:55.194905 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:55.194911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:55.194912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:55.195272 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:55.195523 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:57:55.195524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:57:55.195524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:57:55.195682 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:57:55.196004 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:57:55.196009 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:57:55.196197 (+ 188us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.196331 (+ 134us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.196495 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260929 22:57:55.197330 16959 heartbeater.cc:347] Connected to a master server at 127.0.124.190:45995
I20260929 22:57:55.197386 16963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.189855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55986 (local address 127.0.124.190:45995)
0929 22:57:55.189986 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.189988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.190143 (+ 155us) server_negotiation.cc:407] Connection header received
0929 22:57:55.190226 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.190226 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.190236 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.190335 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:55.191114 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.191706 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.192632 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.192826 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.192910 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.194061 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:55.194063 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:55.194063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:55.194069 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:55.195661 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.196091 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.196092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.196093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.196157 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.196510 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.196511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.196511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.196635 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:55.196801 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.197193 (+ 392us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.197283 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260929 22:57:55.197432 16959 heartbeater.cc:464] Registering TS with master...
I20260929 22:57:55.197609 16959 heartbeater.cc:511] Master 127.0.124.190:45995 requested a full tablet report, sending...
I20260929 22:57:55.198066 16500 ts_manager.cc:194] Registered new tserver with Master: 236ccf762ac44711911f386603b1398a (127.0.124.131:46855)
I20260929 22:57:55.198494 16500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:44171
I20260929 22:57:55.198874 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:57:55.202045 16963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.199256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.0.124.190:45995)
0929 22:57:55.199295 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.199297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.199390 (+ 93us) server_negotiation.cc:407] Connection header received
0929 22:57:55.199549 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.199549 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.199587 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.199678 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:55.199806 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.200370 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.201156 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.201383 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.201479 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.201655 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:55.201707 (+ 52us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0929 22:57:55.201976 (+ 269us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56002: token expired
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 22:57:55.202092 16963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56002: token expired
W20260929 22:57:55.202239 16430 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.124.190:45995)
I20260929 22:57:55.210356 16963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.202481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56016 (local address 127.0.124.190:45995)
0929 22:57:55.202513 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.202514 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.203272 (+ 758us) server_negotiation.cc:407] Connection header received
0929 22:57:55.203294 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.203295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.203306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.203351 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:57:55.203879 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.204534 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.205480 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.205874 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.205968 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.207344 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:57:55.207345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:57:55.207345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:57:55.207351 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:57:55.209130 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.209531 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.209532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.209532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.209586 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:57:55.209814 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:57:55.209815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:57:55.209815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:57:55.209956 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:57:55.210063 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.210186 (+ 123us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.210262 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:57:55.211454 16501 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:57:55.213114 16501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:57:55.215394 16623 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36e57177a4428af953b8a5ea97023 (DEFAULT_TABLE table=test-table [id=97f5213838da4fd9947486435c3f32d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:55.215615 16623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36e57177a4428af953b8a5ea97023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:55.218115 16581 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap starting.
I20260929 22:57:55.218523 16581 tablet_bootstrap.cc:654] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:55.218806 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.214948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:46855 (local address 127.0.0.1:54822)
0929 22:57:55.215268 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.215279 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.215330 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.215625 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.215626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.215628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:55.215661 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.215662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.216784 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.216785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.217679 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.217681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.218564 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.218565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.218627 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.218631 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.218688 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.218726 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":102,"threads_started":1}
I20260929 22:57:55.218818 16966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.215223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54822 (local address 127.0.124.131:46855)
0929 22:57:55.215383 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.215388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.215400 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:57:55.215441 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.215443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.215460 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.215540 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:55.215750 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.216696 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.217785 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.218468 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.218562 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.218620 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.218701 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.218736 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260929 22:57:55.219547 16893 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36e57177a4428af953b8a5ea97023 (DEFAULT_TABLE table=test-table [id=97f5213838da4fd9947486435c3f32d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:55.219642 16581 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: No bootstrap required, opened a new log
I20260929 22:57:55.219708 16581 ts_tablet_manager.cc:1397] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:55.219849 16893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36e57177a4428af953b8a5ea97023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:55.219859 16581 raft_consensus.cc:348] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.219937 16581 raft_consensus.cc:374] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:55.219993 16581 raft_consensus.cc:729] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc4b6f41db4b87a72ba9eab79b9b5c, State: Initialized, Role: FOLLOWER
I20260929 22:57:55.220046 16581 consensus_queue.cc:260] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.220134 16581 ts_tablet_manager.cc:1428] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:57:55.220753 16696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.214938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39973 (local address 127.0.0.1:39064)
0929 22:57:55.215065 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.215075 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.215109 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.215736 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.215737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.215738 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:55.215777 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.215779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.217185 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.217186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.218021 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.218023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.220525 (+ 2502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.220526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.220595 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.220598 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.220646 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.220684 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260929 22:57:55.221091 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.215122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39064 (local address 127.0.124.130:39973)
0929 22:57:55.215555 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.215560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.215570 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:57:55.215607 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.215609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.215626 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.215851 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:55.215935 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.217081 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.218910 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.220425 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.220871 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.220935 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.220961 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.221016 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":336,"threads_started":1}
I20260929 22:57:55.221695 16761 tablet_service.cc:1467] Processing CreateTablet for tablet b6e36e57177a4428af953b8a5ea97023 (DEFAULT_TABLE table=test-table [id=97f5213838da4fd9947486435c3f32d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:57:55.222003 16761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6e36e57177a4428af953b8a5ea97023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:57:55.223121 16969 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Bootstrap starting.
I20260929 22:57:55.223811 16969 tablet_bootstrap.cc:654] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:55.224406 16969 log.cc:824] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:55.225198 16969 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: No bootstrap required, opened a new log
I20260929 22:57:55.225270 16969 ts_tablet_manager.cc:1397] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:57:55.225260 16971 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Bootstrap starting.
I20260929 22:57:55.225862 16971 tablet_bootstrap.cc:654] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Neither blocks nor log segments found. Creating new log.
I20260929 22:57:55.226265 16971 log.cc:824] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Log is configured to *not* fsync() on all Append() calls
I20260929 22:57:55.226912 16971 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: No bootstrap required, opened a new log
I20260929 22:57:55.226970 16971 ts_tablet_manager.cc:1397] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:57:55.226905 16969 raft_consensus.cc:348] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.227111 16969 raft_consensus.cc:374] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:55.227161 16969 raft_consensus.cc:729] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 236ccf762ac44711911f386603b1398a, State: Initialized, Role: FOLLOWER
I20260929 22:57:55.227298 16969 consensus_queue.cc:260] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.227581 16959 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
I20260929 22:57:55.227588 16969 ts_tablet_manager.cc:1428] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 22:57:55.228995 16971 raft_consensus.cc:348] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.229116 16971 raft_consensus.cc:374] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:57:55.229137 16971 raft_consensus.cc:729] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deef186295fc461e8815062985e32036, State: Initialized, Role: FOLLOWER
I20260929 22:57:55.229245 16971 consensus_queue.cc:260] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.229467 16971 ts_tablet_manager.cc:1428] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:57:55.229597 16827 heartbeater.cc:503] Master 127.0.124.190:45995 was elected leader, sending a full tablet report...
W20260929 22:57:55.298657 16828 tablet.cc:2369] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:55.407253 16973 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:57:55.407377 16973 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.407792 16973 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deef186295fc461e8815062985e32036 (127.0.124.130:39973), e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115)
I20260929 22:57:55.411938 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.408295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:57425 (local address 127.0.124.129:45115)
0929 22:57:55.408343 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.408346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.408655 (+ 309us) server_negotiation.cc:407] Connection header received
0929 22:57:55.408683 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.408684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.408693 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.408745 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:55.408946 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.409569 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.411016 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.411565 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.411639 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.411648 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.411829 (+ 181us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.411866 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:57:55.411938 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.408082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:59795 (local address 127.0.124.130:39973)
0929 22:57:55.408167 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.408169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.408180 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:57:55.408267 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.408268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.408278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.408332 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:57:55.408541 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.409288 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.410941 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.411551 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.411631 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.411640 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.411829 (+ 189us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.411866 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260929 22:57:55.411998 16961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.407997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39973 (local address 127.0.124.131:59795)
0929 22:57:55.408064 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.408075 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.408154 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.408377 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.408377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.408379 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:55.408460 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.408462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.409474 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.409475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.410851 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.410854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.411646 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.411647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.411738 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.411740 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.411816 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.411862 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":5}
I20260929 22:57:55.412009 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.408243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45115 (local address 127.0.124.131:57425)
0929 22:57:55.408553 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.408563 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:57:55.408619 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:57:55.408792 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:57:55.408792 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:57:55.408795 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:57:55.408859 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.408861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.409641 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.409642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.410897 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:57:55.410899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.411646 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.411647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:57:55.411736 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.411740 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:57:55.411809 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:57:55.411862 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":5,"thread_start_us":165,"threads_started":1}
I20260929 22:57:55.412453 16632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36e57177a4428af953b8a5ea97023" candidate_uuid: "236ccf762ac44711911f386603b1398a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" is_pre_election: true
I20260929 22:57:55.412468 16781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36e57177a4428af953b8a5ea97023" candidate_uuid: "236ccf762ac44711911f386603b1398a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deef186295fc461e8815062985e32036" is_pre_election: true
I20260929 22:57:55.412631 16632 raft_consensus.cc:2454] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 236ccf762ac44711911f386603b1398a in term 0.
I20260929 22:57:55.412657 16781 raft_consensus.cc:2454] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 236ccf762ac44711911f386603b1398a in term 0.
I20260929 22:57:55.412863 16847 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 236ccf762ac44711911f386603b1398a, e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters:
I20260929 22:57:55.413004 16973 raft_consensus.cc:2781] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:57:55.413100 16973 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:57:55.413141 16973 raft_consensus.cc:3037] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:55.413837 16973 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.413975 16973 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [CANDIDATE]: Term 1 election: Requested vote from peers deef186295fc461e8815062985e32036 (127.0.124.130:39973), e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115)
I20260929 22:57:55.414215 16781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36e57177a4428af953b8a5ea97023" candidate_uuid: "236ccf762ac44711911f386603b1398a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deef186295fc461e8815062985e32036"
I20260929 22:57:55.414224 16632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6e36e57177a4428af953b8a5ea97023" candidate_uuid: "236ccf762ac44711911f386603b1398a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
I20260929 22:57:55.414302 16632 raft_consensus.cc:3037] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:55.414302 16781 raft_consensus.cc:3037] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:57:55.415343 16781 raft_consensus.cc:2454] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 236ccf762ac44711911f386603b1398a in term 1.
I20260929 22:57:55.415516 16847 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036; no voters:
I20260929 22:57:55.415627 16973 raft_consensus.cc:2781] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:57:55.415771 16973 raft_consensus.cc:686] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 1 LEADER]: Becoming Leader. State: Replica: 236ccf762ac44711911f386603b1398a, State: Running, Role: LEADER
I20260929 22:57:55.415777 16632 raft_consensus.cc:2454] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 236ccf762ac44711911f386603b1398a in term 1.
I20260929 22:57:55.415866 16973 consensus_queue.cc:237] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:57:55.416651 16500 catalog_manager.cc:5495] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a reported cstate change: term changed from 0 to 1, leader changed from <none> to 236ccf762ac44711911f386603b1398a (127.0.124.131). New cstate: current_term: 1 leader_uuid: "236ccf762ac44711911f386603b1398a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } health_report { overall_health: UNKNOWN } } }
W20260929 22:57:55.420632 16690 tablet.cc:2369] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:57:55.435811 16960 tablet.cc:2369] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:57:55.447592 16966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.445294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54824 (local address 127.0.124.131:46855)
0929 22:57:55.445359 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:57:55.445361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:57:55.445368 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:57:55.445421 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:57:55.445422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:57:55.445437 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:57:55.445490 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:57:55.445601 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.446047 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.446825 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:57:55.446996 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:57:55.447043 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:57:55.447265 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:57:55.447362 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:57:55.447422 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:57:55.447461 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:57:55.447478 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:57:55.449465 16632 raft_consensus.cc:1261] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Refusing update from remote peer 236ccf762ac44711911f386603b1398a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:55.449442 16781 raft_consensus.cc:1261] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Refusing update from remote peer 236ccf762ac44711911f386603b1398a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:57:55.449880 16973 consensus_queue.cc:1035] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:55.450029 16976 consensus_queue.cc:1035] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [LEADER]: Connected to new peer: Peer: permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:57:55.451928 16979 mvcc.cc:205] Tried to move back new op lower bound from 7334800078638129152 to 7334800078504034304. Current Snapshot: MvccSnapshot[applied={T|T < 7334800078638129152}]
I20260929 22:57:55.453879 16982 mvcc.cc:205] Tried to move back new op lower bound from 7334800078638129152 to 7334800078504034304. Current Snapshot: MvccSnapshot[applied={T|T < 7334800078638129152 or (T in {7334800078638129152})}]
I20260929 22:57:55.454094 16500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:55.454183 16500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:57:55.454937 16500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Sending DeleteTablet for 3 replicas of tablet b6e36e57177a4428af953b8a5ea97023
I20260929 22:57:55.455276 16761 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36e57177a4428af953b8a5ea97023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:39064
I20260929 22:57:55.455341 16893 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36e57177a4428af953b8a5ea97023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:54822
I20260929 22:57:55.455334 16623 tablet_service.cc:1514] Processing DeleteTablet for tablet b6e36e57177a4428af953b8a5ea97023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:57:55 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:58094
I20260929 22:57:55.455546 16991 tablet_replica.cc:330] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: stopping tablet replica
I20260929 22:57:55.455545 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16540
I20260929 22:57:55.457348 16989 tablet_replica.cc:330] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: stopping tablet replica
I20260929 22:57:55.457513 16989 raft_consensus.cc:2229] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:57:55.457532 16990 tablet_replica.cc:330] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: stopping tablet replica
I20260929 22:57:55.457639 16990 raft_consensus.cc:2229] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:57:55.457736 16990 raft_consensus.cc:2258] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:55.457736 16989 raft_consensus.cc:2258] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:57:55.458201 16989 ts_tablet_manager.cc:1905] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:55.460282 16989 ts_tablet_manager.cc:1918] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:55.460403 16989 log.cc:1196] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/b6e36e57177a4428af953b8a5ea97023
I20260929 22:57:55.460750 16989 ts_tablet_manager.cc:1939] T b6e36e57177a4428af953b8a5ea97023 P deef186295fc461e8815062985e32036: Deleting consensus metadata
I20260929 22:57:55.461318 16486 catalog_manager.cc:4841] TS deef186295fc461e8815062985e32036 (127.0.124.130:39973): tablet b6e36e57177a4428af953b8a5ea97023 (table test-table [id=97f5213838da4fd9947486435c3f32d8]) successfully deleted
W20260929 22:57:55.461548 16486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:45115 (error 108)
I20260929 22:57:55.461967 16990 ts_tablet_manager.cc:1905] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:57:55.462040 16696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:57:55.461925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45115 (local address 127.0.0.1:58100)
0929 22:57:55.461970 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:57:55.462009 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 22:57:55.462121 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16694
W20260929 22:57:55.462153 16486 catalog_manager.cc:4584] TS e8bc4b6f41db4b87a72ba9eab79b9b5c (127.0.124.129:45115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6e36e57177a4428af953b8a5ea97023: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45115: connect: Connection refused (error 111)
I20260929 22:57:55.464542 16990 ts_tablet_manager.cc:1918] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:57:55.464643 16990 log.cc:1196] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/b6e36e57177a4428af953b8a5ea97023
I20260929 22:57:55.464955 16990 ts_tablet_manager.cc:1939] T b6e36e57177a4428af953b8a5ea97023 P 236ccf762ac44711911f386603b1398a: Deleting consensus metadata
I20260929 22:57:55.465365 16487 catalog_manager.cc:4841] TS 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): tablet b6e36e57177a4428af953b8a5ea97023 (table test-table [id=97f5213838da4fd9947486435c3f32d8]) successfully deleted
I20260929 22:57:55.467584 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16830
I20260929 22:57:55.472741 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 16468
I20260929 22:58:15.478348 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--webserver_interface=127.0.124.190
--webserver_port=40293
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:45995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:15.557269 16993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:15.557453 16993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:15.557474 16993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:15.558511 16993 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:58:15.558539 16993 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:58:15.558552 16993 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:58:15.558564 16993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:15.558578 16993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:15.558591 16993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:15.558607 16993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:15.558624 16993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:15.559978 16993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:45995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:45995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:15.560148 16993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:15.560374 16993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:15.565583 16993 server_base.cc:1034] running on GCE node
W20260929 22:58:15.565605 16999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.565562 16998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.565760 17001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.566002 16993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:15.566232 16993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:15.567368 16993 hybrid_clock.cc:648] HybridClock initialized: now 1790722695567348 us; error 35 us; skew 500 ppm
Sep 29 22:58:15 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:15.574134 16993 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:15.574574 16993 webserver.cc:460] Webserver started at http://127.0.124.190:40293/ using document root <none> and password file <none>
I20260929 22:58:15.574767 16993 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:15.574808 16993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:15.576093 16993 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:15.576807 17008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.577028 16993 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:58:15.577144 16993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "87533f93249c4acab7088dd62b225d35"
format_stamp: "Formatted at 2026-09-29 22:57:33 on dist-test-slave-512q"
server_key: "4358e4a4d46fc8677664066af179ae3b"
server_key_iv: "9f4049a0945174d7dca944523c01cb7e"
server_key_version: "encryptionkey@0"
I20260929 22:58:15.577474 16993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:15.586889 16993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:15.589162 16993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:15.589318 16993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:15.593268 16993 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:45995
I20260929 22:58:15.593297 17060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:45995 every 8 connection(s)
I20260929 22:58:15.593645 16993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:15.594995 17061 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:58:15.595671 17061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap starting.
I20260929 22:58:15.603243 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 16993
I20260929 22:58:15.603652 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:45115
--local_ip_for_outbound_sockets=127.0.124.129
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=41773
--webserver_interface=127.0.124.129
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:58:15.604295 17061 log.cc:824] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:15.606491 17061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:58:15.606788 17061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: Bootstrap complete.
I20260929 22:58:15.609086 17061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:58:15.609298 17061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Initialized, Role: FOLLOWER
I20260929 22:58:15.609586 17061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:58:15.609684 17061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:15.609737 17061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:15.609786 17061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 2 FOLLOWER]: Advancing to term 3
I20260929 22:58:15.610810 17061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:58:15.610926 17061 leader_election.cc:302] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87533f93249c4acab7088dd62b225d35; no voters:
I20260929 22:58:15.611106 17061 leader_election.cc:288] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 22:58:15.611178 17065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 22:58:15.611369 17061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:15.611387 17065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [term 3 LEADER]: Becoming Leader. State: Replica: 87533f93249c4acab7088dd62b225d35, State: Running, Role: LEADER
I20260929 22:58:15.611479 17065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } }
I20260929 22:58:15.611748 17065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87533f93249c4acab7088dd62b225d35. Latest consensus state: current_term: 3 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:58:15.611748 17066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "87533f93249c4acab7088dd62b225d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87533f93249c4acab7088dd62b225d35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 45995 } } }
I20260929 22:58:15.611845 17065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:15.611876 17066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:15.613104 17081 catalog_manager.cc:1259] Loaded cluster ID: 1ee6c76f6a1a4e1c95db9b08177899e5
I20260929 22:58:15.613180 17081 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: loading cluster ID for follower catalog manager: success
I20260929 22:58:15.614259 17081 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 87533f93249c4acab7088dd62b225d35: acquiring CA information for follower catalog manager: success
F20260929 22:58:15.614620 17081 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd7a4cf69ad google::LogMessage::Fail() at ??:0
@ 0x7fd7a4cf988a google::LogMessage::SendToLog() at ??:0
@ 0x7fd7a4cf64de google::LogMessage::Flush() at ??:0
@ 0x7fd7a4cf7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd7a7463104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd7acc4f6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fd7acc4f989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fd7acc4fe4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fd7acc528c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fd7a6bb9954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd7a7a1d6db start_thread at ??:0
@ 0x7fd7a37f461f clone at ??:0
W20260929 22:58:15.691784 17064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:15.692003 17064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:15.692041 17064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:15.693220 17064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:15.693284 17064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:15.693327 17064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:15.694907 17064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:45115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=41773
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:15.695174 17064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:15.695396 17064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:15.701661 17064 server_base.cc:1034] running on GCE node
W20260929 22:58:15.701772 17102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.701871 17100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.701848 17099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.702248 17064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:15.702487 17064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:15.703653 17064 hybrid_clock.cc:648] HybridClock initialized: now 1790722695703624 us; error 48 us; skew 500 ppm
Sep 29 22:58:15 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:15.706070 17064 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:58:15.706504 17064 webserver.cc:460] Webserver started at http://127.0.124.129:41773/ using document root <none> and password file <none>
I20260929 22:58:15.706727 17064 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:15.706797 17064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:15.708243 17064 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:15.708951 17109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.709121 17064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:15.709228 17064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "f80534dd9a9b1e928845d507c5852814"
server_key_iv: "19e6ef5eee5334981559f0e9165583ed"
server_key_version: "encryptionkey@0"
I20260929 22:58:15.709571 17064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:15.723531 17064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:15.725747 17064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:15.725898 17064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:15.726109 17064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:15.726563 17116 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:58:15.728482 17064 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:58:15.728538 17064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:58:15.728577 17064 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:58:15.729209 17064 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:58:15.729264 17064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:58:15.729307 17116 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap starting.
I20260929 22:58:15.736351 17064 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45115
I20260929 22:58:15.736392 17223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45115 every 8 connection(s)
I20260929 22:58:15.736742 17064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:58:15.738646 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17064
I20260929 22:58:15.738950 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:39973
--local_ip_for_outbound_sockets=127.0.124.130
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=39747
--webserver_interface=127.0.124.130
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:58:15.740069 17116 log.cc:824] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:15.742648 17116 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:58:15.742950 17116 tablet_bootstrap.cc:492] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Bootstrap complete.
I20260929 22:58:15.744146 17116 ts_tablet_manager.cc:1397] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.010s
I20260929 22:58:15.745527 17116 raft_consensus.cc:348] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:15.745844 17116 raft_consensus.cc:729] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc4b6f41db4b87a72ba9eab79b9b5c, State: Initialized, Role: FOLLOWER
I20260929 22:58:15.745975 17116 consensus_queue.cc:260] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:15.746219 17116 ts_tablet_manager.cc:1428] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260929 22:58:15.801854 17226 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:58:15.737377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:42007)
0929 22:58:15.737532 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.737572 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:15.738123 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:15.801649 (+ 63526us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
W20260929 22:58:15.802136 17224 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:45995 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:45995: Client connection negotiation failed: client connection to 127.0.124.190:45995: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:58:15.802513 17226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.802380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:34163)
0929 22:58:15.802440 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.802488 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:58:15.802835 17226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.802751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:45995)
0929 22:58:15.802792 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.802818 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 22:58:15.802951 17224 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:58:15.827206 17227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:15.827394 17227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:15.827419 17227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:15.828680 17227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:15.828720 17227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:15.828769 17227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:15.830233 17227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:39973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=39747
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:15.830461 17227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:15.830684 17227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:15.835628 17237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.835659 17227 server_base.cc:1034] running on GCE node
W20260929 22:58:15.835681 17235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.835743 17234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.835960 17227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:15.836191 17227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:15.837389 17227 hybrid_clock.cc:648] HybridClock initialized: now 1790722695837372 us; error 35 us; skew 500 ppm
Sep 29 22:58:15 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:15.839772 17227 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:58:15.840181 17227 webserver.cc:460] Webserver started at http://127.0.124.130:39747/ using document root <none> and password file <none>
I20260929 22:58:15.840430 17227 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:15.840499 17227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:15.841763 17227 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:15.842325 17244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.842540 17227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:15.842635 17227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "deef186295fc461e8815062985e32036"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "5cf7c776ecd2bc26d771cb9578069dbb"
server_key_iv: "1fd61c3d5f282eab67438c2293fe9bab"
server_key_version: "encryptionkey@0"
I20260929 22:58:15.842964 17227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:15.860141 17227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:15.861914 17227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:15.862077 17227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:15.862298 17227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:15.862600 17227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:15.862654 17227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.862694 17227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:15.862722 17227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.868345 17227 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39973
I20260929 22:58:15.868420 17357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39973 every 8 connection(s)
I20260929 22:58:15.868750 17227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:15.869772 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.869415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:47505)
0929 22:58:15.869579 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.869641 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
W20260929 22:58:15.870196 17358 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:45995 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:45995: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
I20260929 22:58:15.870465 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.870376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:42283)
0929 22:58:15.870418 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.870445 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 22:58:15.870770 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.870694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:52937)
0929 22:58:15.870734 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.870755 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 22:58:15.870900 17358 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:58:15.875253 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17227
I20260929 22:58:15.875476 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:46855
--local_ip_for_outbound_sockets=127.0.124.131
--tserver_master_addrs=127.0.124.190:45995
--webserver_port=42491
--webserver_interface=127.0.124.131
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:15.953899 17361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:15.954118 17361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:15.954155 17361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:15.955295 17361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:15.955361 17361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:15.955405 17361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:15.956894 17361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:46855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=42491
--tserver_master_addrs=127.0.124.190:45995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:15.957157 17361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:15.957376 17361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:15.962091 17366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.962239 17361 server_base.cc:1034] running on GCE node
W20260929 22:58:15.962091 17369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:15.962105 17367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:15.962555 17361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:15.962779 17361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:15.963948 17361 hybrid_clock.cc:648] HybridClock initialized: now 1790722695963933 us; error 26 us; skew 500 ppm
Sep 29 22:58:15 dist-test-slave-512q krb5kdc[15921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:15.966308 17361 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:58:15.966699 17361 webserver.cc:460] Webserver started at http://127.0.124.131:42491/ using document root <none> and password file <none>
I20260929 22:58:15.966917 17361 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:15.966979 17361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:15.968283 17361 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:15.968916 17376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.969158 17361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:15.969244 17361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "236ccf762ac44711911f386603b1398a"
format_stamp: "Formatted at 2026-09-29 22:57:34 on dist-test-slave-512q"
server_key: "295db93b88da63f88cd8cfe9cc098592"
server_key_iv: "0527c2b431b39a43a21d745d1e0f0a2c"
server_key_version: "encryptionkey@0"
I20260929 22:58:15.969678 17361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:15.984537 17361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:15.986167 17361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:15.986363 17361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:15.986589 17361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:15.986899 17361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:15.986941 17361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.986979 17361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:15.987007 17361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:15.992568 17361 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:46855
I20260929 22:58:15.992647 17489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:46855 every 8 connection(s)
I20260929 22:58:15.992969 17361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:58:15.993906 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.993570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:33265)
0929 22:58:15.993721 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.993781 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
W20260929 22:58:15.994279 17490 heartbeater.cc:644] Failed to heartbeat to 127.0.124.190:45995 (0 consecutive failures): Network error: Failed to ping master at 127.0.124.190:45995: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
I20260929 22:58:15.994560 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.994463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:59487)
0929 22:58:15.994520 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.994544 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:58:15.994796 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:15.994749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:38209)
0929 22:58:15.994767 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:15.994783 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260929 22:58:15.994930 17490 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:58:15.999789 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17361
I20260929 22:58:16.803481 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.803271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:56229)
0929 22:58:16.803385 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:16.803418 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260929 22:58:16.871366 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.871177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:52463)
0929 22:58:16.871278 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:16.871310 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":51,"threads_started":1}
I20260929 22:58:16.871726 17496 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:16.871855 17496 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:16.872193 17496 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 236ccf762ac44711911f386603b1398a (127.0.124.131:46855), deef186295fc461e8815062985e32036 (127.0.124.130:39973)
Sep 29 22:58:16 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.130@KRBTEST.COM
Sep 29 22:58:16 dist-test-slave-512q krb5kdc[15921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.131@KRBTEST.COM
I20260929 22:58:16.882596 17497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.872366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39973 (local address 127.0.124.129:33589)
0929 22:58:16.872518 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:16.872529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:16.872582 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:16.873302 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:16.873303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:16.873664 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:16.873894 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:16.873900 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.875032 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.875033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:16.876011 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:16.876013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.876645 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:16.876771 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:16.877371 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:16.877383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:16.878872 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:16.881072 (+ 2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881078 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:16.881080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:16.881295 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:16.881597 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:16.881599 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:16.881701 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:16.882079 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:16.882085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:16.882207 (+ 122us) client_negotiation.cc:769] Sending connection context
0929 22:58:16.882312 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 22:58:16.882492 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":4,"thread_start_us":77,"threads_started":1}
I20260929 22:58:16.882611 17499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.872508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:33589 (local address 127.0.124.130:39973)
0929 22:58:16.872734 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:16.872742 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:16.872766 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:58:16.873136 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:16.873138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:16.873172 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:16.873309 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:16.874007 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.874939 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876102 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.876534 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876674 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:16.878976 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:16.878980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:16.878980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:16.878989 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:16.880967 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881420 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:16.881424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:16.881424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:16.881516 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881776 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:16.881777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:16.881777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:16.882001 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:16.882087 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:16.882362 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 22:58:16.882480 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":58,"threads_started":1}
I20260929 22:58:16.882741 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.872319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:46855 (local address 127.0.124.129:47389)
0929 22:58:16.872363 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:16.872373 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:16.872441 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:16.873251 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:16.873254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:16.873682 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:16.873894 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:16.873900 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.875096 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.875097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:16.876013 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:16.876015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.876642 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:16.876764 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:16.877322 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:16.877336 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:16.879261 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:16.881312 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:16.881314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:16.881493 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:16.881747 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:16.881749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:16.881810 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:16.882183 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:16.882184 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:16.882226 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 22:58:16.882318 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:58:16.882580 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":173}
I20260929 22:58:16.882632 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.872434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:47389 (local address 127.0.124.131:46855)
0929 22:58:16.872605 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:16.872616 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:16.872642 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:58:16.873033 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:16.873035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:16.873083 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:16.873229 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:16.874016 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.874951 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876093 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:16.876537 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:16.876675 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:16.879386 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:16.879390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:16.879390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:16.879399 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:16.881228 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881585 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:16.881588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:16.881588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:16.881678 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:16.881882 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:16.881883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:16.881883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:16.882104 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:16.882188 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:16.882372 (+ 184us) server_negotiation.cc:299] Negotiation successful
0929 22:58:16.882522 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":56,"threads_started":1}
W20260929 22:58:16.883473 17111 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer deef186295fc461e8815062985e32036 (127.0.124.130:39973): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
W20260929 22:58:16.884051 17112 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
I20260929 22:58:16.884111 17112 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036
I20260929 22:58:16.884239 17496 raft_consensus.cc:2726] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:58:16.995427 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:16.995232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:49637)
0929 22:58:16.995354 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:16.995394 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260929 22:58:17.804194 17501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:17.803946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:56279)
0929 22:58:17.804110 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:17.804148 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":101,"threads_started":1}
I20260929 22:58:17.871942 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:17.871767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:34673)
0929 22:58:17.871880 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:17.871909 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
I20260929 22:58:17.996158 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:17.995950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:54211)
0929 22:58:17.996065 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:17.996099 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":55,"threads_started":1}
I20260929 22:58:18.804957 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:18.804742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:35357)
0929 22:58:18.804875 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:18.804912 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260929 22:58:18.872488 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:18.872317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:40777)
0929 22:58:18.872426 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:18.872453 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
I20260929 22:58:18.996742 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:18.996567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:42981)
0929 22:58:18.996679 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:18.996710 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
I20260929 22:58:19.002877 17507 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:19.002951 17507 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:19.003145 17507 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 236ccf762ac44711911f386603b1398a (127.0.124.131:46855), deef186295fc461e8815062985e32036 (127.0.124.130:39973)
W20260929 22:58:19.003511 17112 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
W20260929 22:58:19.003577 17111 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer deef186295fc461e8815062985e32036 (127.0.124.130:39973): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
I20260929 22:58:19.003645 17111 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036
I20260929 22:58:19.003717 17507 raft_consensus.cc:2726] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:58:19.805678 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:19.805435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:46689)
0929 22:58:19.805572 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:19.805615 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260929 22:58:19.873018 17509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:19.872827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:52603)
0929 22:58:19.872941 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:19.872973 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260929 22:58:19.997309 17510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:19.997125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:55279)
0929 22:58:19.997241 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:19.997273 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260929 22:58:20.806357 17511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:20.806143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:53535)
0929 22:58:20.806275 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:20.806311 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260929 22:58:20.818957 17512 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:20.819041 17512 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:20.819190 17512 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 236ccf762ac44711911f386603b1398a (127.0.124.131:46855), deef186295fc461e8815062985e32036 (127.0.124.130:39973)
W20260929 22:58:20.819550 17112 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
W20260929 22:58:20.819639 17111 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer deef186295fc461e8815062985e32036 (127.0.124.130:39973): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
I20260929 22:58:20.819725 17111 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036
I20260929 22:58:20.819802 17512 raft_consensus.cc:2726] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:58:20.873561 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:20.873397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:54191)
0929 22:58:20.873493 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:20.873525 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":50,"threads_started":1}
I20260929 22:58:20.997924 17514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:20.997707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:48277)
0929 22:58:20.997821 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:20.997855 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260929 22:58:21.807003 17515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:21.806800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:42783)
0929 22:58:21.806920 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:21.806955 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260929 22:58:21.874128 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:21.873904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:33867)
0929 22:58:21.874038 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:21.874089 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":56,"threads_started":1}
I20260929 22:58:21.998700 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:21.998383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:34157)
0929 22:58:21.998604 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:21.998642 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":144,"threads_started":1}
I20260929 22:58:22.807782 17518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:22.807532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:58959)
0929 22:58:22.807694 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:22.807735 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":78,"threads_started":1}
I20260929 22:58:22.874778 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:22.874559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:44265)
0929 22:58:22.874711 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:22.874743 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260929 22:58:22.999261 17520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:22.999080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:54397)
0929 22:58:22.999195 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:22.999224 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
I20260929 22:58:23.387769 17521 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:23.387889 17521 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:23.388083 17521 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 236ccf762ac44711911f386603b1398a (127.0.124.131:46855), deef186295fc461e8815062985e32036 (127.0.124.130:39973)
W20260929 22:58:23.388463 17112 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
W20260929 22:58:23.388549 17111 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer deef186295fc461e8815062985e32036 (127.0.124.130:39973): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
I20260929 22:58:23.388628 17111 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036
I20260929 22:58:23.388710 17521 raft_consensus.cc:2726] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:58:23.808403 17522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:23.808182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:35535)
0929 22:58:23.808319 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:23.808356 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260929 22:58:23.875370 17523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:23.875195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:37229)
0929 22:58:23.875288 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:23.875318 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":54,"threads_started":1}
I20260929 22:58:24.000028 17524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:23.999811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:57509)
0929 22:58:23.999962 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:23.999990 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260929 22:58:24.809079 17525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:24.808859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:53053)
0929 22:58:24.808993 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:24.809033 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260929 22:58:24.876056 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:24.875831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:38001)
0929 22:58:24.875973 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:24.876012 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260929 22:58:25.000732 17527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:25.000500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:57411)
0929 22:58:25.000650 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:25.000688 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260929 22:58:25.809733 17528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:25.809520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:38825)
0929 22:58:25.809654 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:25.809685 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260929 22:58:25.876650 17529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:25.876467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:40947)
0929 22:58:25.876569 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:25.876604 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":54,"threads_started":1}
I20260929 22:58:26.001355 17530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:26.001151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:52835)
0929 22:58:26.001281 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:26.001315 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260929 22:58:26.104951 17531 raft_consensus.cc:482] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:26.105042 17531 raft_consensus.cc:504] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "236ccf762ac44711911f386603b1398a" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46855 } } peers { permanent_uuid: "deef186295fc461e8815062985e32036" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39973 } } peers { permanent_uuid: "e8bc4b6f41db4b87a72ba9eab79b9b5c" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45115 } }
I20260929 22:58:26.105199 17531 leader_election.cc:288] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 236ccf762ac44711911f386603b1398a (127.0.124.131:46855), deef186295fc461e8815062985e32036 (127.0.124.130:39973)
W20260929 22:58:26.105587 17112 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 236ccf762ac44711911f386603b1398a (127.0.124.131:46855): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
W20260929 22:58:26.105665 17111 leader_election.cc:341] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer deef186295fc461e8815062985e32036 (127.0.124.130:39973): Not found: Tablet not found: b6e36e57177a4428af953b8a5ea97023
I20260929 22:58:26.105741 17111 leader_election.cc:302] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc4b6f41db4b87a72ba9eab79b9b5c; no voters: 236ccf762ac44711911f386603b1398a, deef186295fc461e8815062985e32036
I20260929 22:58:26.105834 17531 raft_consensus.cc:2726] T b6e36e57177a4428af953b8a5ea97023 P e8bc4b6f41db4b87a72ba9eab79b9b5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:58:26.810456 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:26.810183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:48605)
0929 22:58:26.810327 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:26.810366 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260929 22:58:26.877256 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:26.877048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:42927)
0929 22:58:26.877174 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:26.877212 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260929 22:58:27.001946 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:27.001745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:43101)
0929 22:58:27.001868 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:27.001904 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260929 22:58:27.811106 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:27.810890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:40441)
0929 22:58:27.811026 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:27.811060 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260929 22:58:27.877926 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:27.877740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:35727)
0929 22:58:27.877850 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:27.877885 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260929 22:58:28.002614 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:28.002388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:58569)
0929 22:58:28.002531 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:28.002569 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260929 22:58:28.811702 17538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:28.811488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:42991)
0929 22:58:28.811621 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:28.811657 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260929 22:58:28.878509 17539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:28.878321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:39601)
0929 22:58:28.878441 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:28.878471 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260929 22:58:29.003525 17540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:29.003227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:54715)
0929 22:58:29.003441 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:29.003481 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":84,"threads_started":1}
I20260929 22:58:29.812451 17541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:29.812182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:50983)
0929 22:58:29.812360 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:29.812391 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":131,"threads_started":1}
I20260929 22:58:29.879112 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:29.878923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:60915)
0929 22:58:29.879041 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:29.879073 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260929 22:58:30.004402 17543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:30.004131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:53587)
0929 22:58:30.004321 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:30.004356 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":90,"threads_started":1}
I20260929 22:58:30.813167 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:30.812963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.129:56513)
0929 22:58:30.813083 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:30.813121 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260929 22:58:30.879892 17545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:30.879645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.130:38215)
0929 22:58:30.879783 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:30.879819 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260929 22:58:31.004598 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17064
I20260929 22:58:31.006270 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:31.006076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:45995 (local address 127.0.124.131:57035)
0929 22:58:31.006194 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:31.006229 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.190:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260929 22:58:31.009438 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17227
I20260929 22:58:31.013907 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17361
2026-09-29T22:58:31Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58304 ms)
[----------] 30 tests from SecurityITest (227447 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:31 dist-test-slave-512q krb5kdc[17549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:31 dist-test-slave-512q krb5kdc[17549](info): set up 2 sockets
Sep 29 22:58:31 dist-test-slave-512q krb5kdc[17549](info): commencing operation
krb5kdc: starting...
W20260929 22:58:32.050036 498 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:32.164613 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35659
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:35659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:32.241946 17562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:32.242136 17562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:32.242157 17562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:32.243278 17562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:32.243319 17562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:32.243333 17562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:32.243383 17562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:32.243403 17562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:32.244835 17562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:35659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:32.245072 17562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:32.245307 17562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:32.250377 17567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.250370 17568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.250370 17570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:32.250403 17562 server_base.cc:1034] running on GCE node
I20260929 22:58:32.250790 17562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:32.251066 17562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:32.252256 17562 hybrid_clock.cc:648] HybridClock initialized: now 1790722712252233 us; error 34 us; skew 500 ppm
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:32.254570 17562 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:32.255020 17562 webserver.cc:460] Webserver started at http://127.0.124.190:33319/ using document root <none> and password file <none>
I20260929 22:58:32.255237 17562 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:32.255301 17562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:32.255448 17562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:32.256539 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "caa15810b6d149a786127e8c7dec5485"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "7ff63a43e558bca45a972aeeaba3e7d4"
server_key_iv: "d3211c54d67ec818f32932d19ab0a9fd"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.256891 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "caa15810b6d149a786127e8c7dec5485"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "7ff63a43e558bca45a972aeeaba3e7d4"
server_key_iv: "d3211c54d67ec818f32932d19ab0a9fd"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.258196 17562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:32.258888 17577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.259063 17562 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:32.259159 17562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "caa15810b6d149a786127e8c7dec5485"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "7ff63a43e558bca45a972aeeaba3e7d4"
server_key_iv: "d3211c54d67ec818f32932d19ab0a9fd"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.259238 17562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:32.291424 17562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:32.293355 17562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:32.293525 17562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:32.297473 17562 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:35659
I20260929 22:58:32.297525 17629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:35659 every 8 connection(s)
I20260929 22:58:32.297895 17562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:32.298584 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17562
I20260929 22:58:32.298695 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:32.298909 498 external_mini_cluster.cc:1428] Setting key 55dc1069cf72968e70bd00c48189cdfe
I20260929 22:58:32.298923 17630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:32.302196 17630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: Bootstrap starting.
I20260929 22:58:32.302899 17630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:32.303213 17630 log.cc:824] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:32.303941 17630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: No bootstrap required, opened a new log
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:32.306145 17630 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } }
I20260929 22:58:32.306274 17630 raft_consensus.cc:374] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:32.306296 17630 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa15810b6d149a786127e8c7dec5485, State: Initialized, Role: FOLLOWER
I20260929 22:58:32.306430 17630 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } }
I20260929 22:58:32.306514 17630 raft_consensus.cc:388] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:32.306546 17630 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:32.306644 17630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:32.307310 17630 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } }
I20260929 22:58:32.307396 17630 leader_election.cc:302] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: caa15810b6d149a786127e8c7dec5485; no voters:
I20260929 22:58:32.307574 17630 leader_election.cc:288] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:32.307605 17635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:32.307715 17635 raft_consensus.cc:686] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [term 1 LEADER]: Becoming Leader. State: Replica: caa15810b6d149a786127e8c7dec5485, State: Running, Role: LEADER
I20260929 22:58:32.307847 17630 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:32.307847 17635 consensus_queue.cc:237] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } }
I20260929 22:58:32.308655 17636 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa15810b6d149a786127e8c7dec5485. Latest consensus state: current_term: 1 leader_uuid: "caa15810b6d149a786127e8c7dec5485" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } } }
I20260929 22:58:32.309149 17636 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:32.309067 17637 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "caa15810b6d149a786127e8c7dec5485" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa15810b6d149a786127e8c7dec5485" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35659 } } }
I20260929 22:58:32.309542 17637 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485 [sys.catalog]: This master's current role is: LEADER
W20260929 22:58:32.309681 17650 catalog_manager.cc:1558] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:58:32.309737 17650 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:58:32.309784 17651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:32.309916 17651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:32.310122 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.299401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37080 (local address 127.0.124.190:35659)
0929 22:58:32.299581 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.299597 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.299625 (+ 28us) server_negotiation.cc:407] Connection header received
0929 22:58:32.300030 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.300037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.300082 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.300192 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:32.300977 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.301839 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.302914 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.303397 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.303517 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.306150 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:32.306154 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:32.306154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:32.306165 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:32.308168 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.308603 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.308607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.308607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.308712 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.308934 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.308934 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.308935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.309243 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:32.309373 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.309659 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.309822 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260929 22:58:32.311393 17651 catalog_manager.cc:1347] Generated new cluster ID: 877c8d19f3d54dd68aa991af18d3741c
I20260929 22:58:32.311447 17651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:32.329996 17651 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:32.330561 17651 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:32.340909 17651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: Generated new TSK 0
I20260929 22:58:32.341120 17651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:58:32.368902 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:32.451502 17656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:32.451691 17656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:32.451715 17656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:32.452935 17656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:32.452979 17656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:32.453006 17656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:32.454401 17656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:32.454577 17656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:32.454744 17656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:32.459585 17662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.459787 17661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.459597 17664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:32.459918 17656 server_base.cc:1034] running on GCE node
I20260929 22:58:32.460121 17656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:32.460386 17656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:32.461555 17656 hybrid_clock.cc:648] HybridClock initialized: now 1790722712461540 us; error 41 us; skew 500 ppm
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:32.464192 17656 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:58:32.464701 17656 webserver.cc:460] Webserver started at http://127.0.124.129:34419/ using document root <none> and password file <none>
I20260929 22:58:32.464918 17656 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:32.464984 17656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:32.465147 17656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:32.466209 17656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "d3c85996ada6903a497d80559e8b96c5"
server_key_iv: "c54f3fd4977258db142f7d7a9a05a8c0"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.466568 17656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "d3c85996ada6903a497d80559e8b96c5"
server_key_iv: "c54f3fd4977258db142f7d7a9a05a8c0"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.467900 17656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 22:58:32.468683 17671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.468838 17656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.468935 17656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "d3c85996ada6903a497d80559e8b96c5"
server_key_iv: "c54f3fd4977258db142f7d7a9a05a8c0"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.469017 17656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:32.477771 17656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:32.479421 17656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:32.479578 17656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:32.479789 17656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:32.480073 17656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:32.480127 17656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.480166 17656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:32.480229 17656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.486495 17656 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:34871
I20260929 22:58:32.486559 17784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:34871 every 8 connection(s)
I20260929 22:58:32.486853 17656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:32.493552 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17656
I20260929 22:58:32.493685 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:32.493872 498 external_mini_cluster.cc:1428] Setting key f9e273bc878cba106357aa7fb4a1bcef
I20260929 22:58:32.496626 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.487521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:37371 (local address 127.0.124.190:35659)
0929 22:58:32.487610 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.487613 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.487784 (+ 171us) server_negotiation.cc:407] Connection header received
0929 22:58:32.488800 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.488801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.488814 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.488894 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:32.489518 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.490026 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.491042 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.491269 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.491354 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.493363 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:32.493365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:32.493365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:32.493373 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:32.494910 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.495402 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.495403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.495404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.495461 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.495770 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.495771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.495771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.495947 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:32.496026 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.496443 (+ 417us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.496538 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260929 22:58:32.496768 17787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.487485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35659 (local address 127.0.124.129:37371)
0929 22:58:32.487664 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.487698 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.488669 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.488986 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.488989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.489232 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:32.489423 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.489427 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.490125 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.490127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.490936 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.490938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.491366 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.491367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.491484 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.491922 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:32.491930 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:32.493261 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:32.494989 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.494996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.494999 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.495309 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.495549 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.495550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.495551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.495681 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.496046 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:32.496052 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:32.496254 (+ 202us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.496399 (+ 145us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.496554 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260929 22:58:32.497239 17785 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35659
I20260929 22:58:32.497339 17785 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:32.497498 17785 heartbeater.cc:511] Master 127.0.124.190:35659 requested a full tablet report, sending...
I20260929 22:58:32.497948 17594 ts_manager.cc:194] Registered new tserver with Master: 3e9b0a1c2e4f44cd92befbd99d6eee69 (127.0.124.129:34871)
I20260929 22:58:32.498581 17594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:37371
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:58:32.519223 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:32.598310 17790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:32.598536 17790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:32.598572 17790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:32.599731 17790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:32.599797 17790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:32.599843 17790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:32.601330 17790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:32.601580 17790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:32.601797 17790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:32.606806 17790 server_base.cc:1034] running on GCE node
W20260929 22:58:32.606827 17798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.606781 17795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.606791 17796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:32.607250 17790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:32.607501 17790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:32.608675 17790 hybrid_clock.cc:648] HybridClock initialized: now 1790722712608660 us; error 25 us; skew 500 ppm
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:32.611207 17790 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:58:32.611583 17790 webserver.cc:460] Webserver started at http://127.0.124.130:34297/ using document root <none> and password file <none>
I20260929 22:58:32.611753 17790 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:32.611792 17790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:32.611877 17790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:32.612896 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "0318a2b101a04053872f2399dea0154d"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "b43bffa5dcbd3f8172e7c823c39de779"
server_key_iv: "f330c7bf76c0c1fb0376fd709e153848"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.613178 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "0318a2b101a04053872f2399dea0154d"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "b43bffa5dcbd3f8172e7c823c39de779"
server_key_iv: "f330c7bf76c0c1fb0376fd709e153848"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.614398 17790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:32.615105 17805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.615289 17790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:32.615356 17790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "0318a2b101a04053872f2399dea0154d"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "b43bffa5dcbd3f8172e7c823c39de779"
server_key_iv: "f330c7bf76c0c1fb0376fd709e153848"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.615407 17790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:32.625455 17790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:32.627070 17790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:32.627172 17790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:32.627328 17790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:32.627569 17790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:32.627599 17790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.627619 17790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:32.627630 17790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.633059 17790 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:35097
I20260929 22:58:32.633124 17918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:35097 every 8 connection(s)
I20260929 22:58:32.633416 17790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:32.633648 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17790
I20260929 22:58:32.633754 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:32.633980 498 external_mini_cluster.cc:1428] Setting key 9e11d58ff69715ab58cde209e9b7cd53
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:58:32.643905 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.634188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:47431 (local address 127.0.124.190:35659)
0929 22:58:32.634240 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.634242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.634451 (+ 209us) server_negotiation.cc:407] Connection header received
0929 22:58:32.635424 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.635426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.635438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.635494 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:32.636387 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.636853 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.638368 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.638551 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.638605 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.641051 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:32.641052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:32.641053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:32.641060 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:32.642635 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.643087 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.643088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.643089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.643149 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.643381 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.643381 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.643382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.643485 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:32.643547 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.643781 (+ 234us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.643843 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:58:32.644069 17921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.634107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35659 (local address 127.0.124.130:47431)
0929 22:58:32.634314 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.634352 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.635315 (+ 963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.635576 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.635580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.635971 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:32.636293 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.636299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.636938 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.636939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.638264 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.638268 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.638637 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.638639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.638782 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.639258 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:32.639268 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:32.640962 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:32.642747 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.642752 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.642754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.642976 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.643222 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.643223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.643223 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.643318 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.643549 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:32.643553 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:32.643663 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.643748 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.643860 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260929 22:58:32.644618 17919 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35659
I20260929 22:58:32.644706 17919 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:32.644840 17919 heartbeater.cc:511] Master 127.0.124.190:35659 requested a full tablet report, sending...
I20260929 22:58:32.645210 17594 ts_manager.cc:194] Registered new tserver with Master: 0318a2b101a04053872f2399dea0154d (127.0.124.130:35097)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
I20260929 22:58:32.645676 17594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:47431
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:58:32.658872 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:32.736030 17924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:32.736223 17924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:32.736248 17924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:32.737365 17924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:32.737418 17924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:32.737444 17924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:32.738823 17924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:35659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:32.739024 17924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:32.739197 17924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:32.743770 17930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.743839 17932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:32.743772 17929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:32.743973 17924 server_base.cc:1034] running on GCE node
I20260929 22:58:32.744197 17924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:32.744534 17924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:32.745685 17924 hybrid_clock.cc:648] HybridClock initialized: now 1790722712745676 us; error 40 us; skew 500 ppm
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:32.747969 17924 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:58:32.748441 17924 webserver.cc:460] Webserver started at http://127.0.124.131:33129/ using document root <none> and password file <none>
I20260929 22:58:32.748672 17924 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:32.748737 17924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:32.748884 17924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:32.749878 17924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "9d9bb54974bf4e3989ac4fd4b24c6809"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "2e1c5ccfdd06dd1d008afa814b3122af"
server_key_iv: "89b6cdb59aa2e5a84feaeedfed38f44d"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.750248 17924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "9d9bb54974bf4e3989ac4fd4b24c6809"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "2e1c5ccfdd06dd1d008afa814b3122af"
server_key_iv: "89b6cdb59aa2e5a84feaeedfed38f44d"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.751487 17924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:32.752128 17939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.752307 17924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:32.752400 17924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "9d9bb54974bf4e3989ac4fd4b24c6809"
format_stamp: "Formatted at 2026-09-29 22:58:32 on dist-test-slave-512q"
server_key: "2e1c5ccfdd06dd1d008afa814b3122af"
server_key_iv: "89b6cdb59aa2e5a84feaeedfed38f44d"
server_key_version: "encryptionkey@0"
I20260929 22:58:32.752475 17924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:32.780586 17924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:32.782404 17924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:32.782577 17924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:32.782816 17924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:32.783149 17924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:32.783205 17924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.783244 17924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:32.783272 17924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:32.788761 17924 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:35359
I20260929 22:58:32.788807 18052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:35359 every 8 connection(s)
I20260929 22:58:32.789108 17924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:58:32.793195 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 17924
I20260929 22:58:32.793292 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:32.793488 498 external_mini_cluster.cc:1428] Setting key 043676e5f72cf7372aa0d0ab611b0885
Sep 29 22:58:32 dist-test-slave-512q krb5kdc[17549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:32.799145 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.789812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:44301 (local address 127.0.124.190:35659)
0929 22:58:32.789874 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.789876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.790074 (+ 198us) server_negotiation.cc:407] Connection header received
0929 22:58:32.790994 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.790995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.791004 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.791055 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:32.791621 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.792167 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.793157 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.793458 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.793524 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.795767 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:32.795768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:32.795769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:32.795775 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:32.798052 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.798393 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.798394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.798395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.798442 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.798639 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.798639 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.798640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.798732 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:32.798799 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.799014 (+ 215us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.799072 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:58:32.799335 18055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.789765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:35659 (local address 127.0.124.131:44301)
0929 22:58:32.789930 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.789971 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.790901 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.791117 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.791120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.791359 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:32.791550 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.791554 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.792285 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.792286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.793064 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.793067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.793568 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.793569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.793698 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.794222 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:32.794230 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:32.795687 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:32.798122 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.798128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.798130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.798330 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.798499 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:32.798499 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:32.798500 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:32.798588 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:32.798801 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:32.798805 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:32.798910 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.798995 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.799107 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260929 22:58:32.799800 18053 heartbeater.cc:347] Connected to a master server at 127.0.124.190:35659
I20260929 22:58:32.799880 18053 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:32.800068 18053 heartbeater.cc:511] Master 127.0.124.190:35659 requested a full tablet report, sending...
I20260929 22:58:32.800489 17594 ts_manager.cc:194] Registered new tserver with Master: 9d9bb54974bf4e3989ac4fd4b24c6809 (127.0.124.131:35359)
I20260929 22:58:32.800864 17594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:44301
I20260929 22:58:32.805124 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:32.812776 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.806442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37090 (local address 127.0.124.190:35659)
0929 22:58:32.806513 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.806516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.806594 (+ 78us) server_negotiation.cc:407] Connection header received
0929 22:58:32.806690 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.806691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.806701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.806754 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:32.807325 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.807840 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.808777 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.808989 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.809060 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.810351 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:32.810353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:32.810353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:32.810360 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:32.811535 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.811893 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.811895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.811895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.811951 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:32.812152 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:32.812152 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:32.812153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:32.812337 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:32.812432 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.812594 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.812670 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:58:32.814328 17594 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:32.815776 17594 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:32.822191 18064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.818104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35359 (local address 127.0.0.1:49316)
0929 22:58:32.818312 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.818321 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.818365 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.818638 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.818641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.818643 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:32.818712 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.818714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.819977 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.819978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.821161 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.821163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.821900 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.821901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.821976 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.821989 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.822060 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.822111 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":1,"thread_start_us":55,"threads_started":1}
I20260929 22:58:32.822283 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.817905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35097 (local address 127.0.0.1:53530)
0929 22:58:32.818010 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.818049 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.818115 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.818969 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.818970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.818972 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:32.819024 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.819025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.820301 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.820307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.821144 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.821147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.822042 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.822043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.822102 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.822104 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.822153 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.822182 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":57,"threads_started":1}
I20260929 22:58:32.822450 18062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.817915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34871 (local address 127.0.0.1:60636)
0929 22:58:32.818215 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:32.818224 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:32.818263 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:32.818842 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:32.818843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:32.818846 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:32.818903 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.818904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.819833 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.819834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.821373 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:32.821375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.822243 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.822244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:32.822308 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.822312 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:32.822338 (+ 26us) client_negotiation.cc:240] Negotiation successful
0929 22:58:32.822373 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":259,"thread_start_us":53,"threads_started":1}
I20260929 22:58:32.822539 18066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.818298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49316 (local address 127.0.124.131:35359)
0929 22:58:32.818459 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.818476 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.818492 (+ 16us) server_negotiation.cc:407] Connection header received
0929 22:58:32.818529 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.818530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.818542 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.818620 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:32.818802 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.819880 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.821242 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.821812 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.821890 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.821947 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.822392 (+ 445us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.822443 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260929 22:58:32.822588 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.818089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53530 (local address 127.0.124.130:35097)
0929 22:58:32.818516 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.818520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.818528 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:58:32.818557 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.818559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.818570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.819124 (+ 554us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:32.819204 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.820127 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.821237 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.821924 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.822040 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.822093 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.822163 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.822209 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":90,"threads_started":1}
I20260929 22:58:32.822799 18063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:32.818063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60636 (local address 127.0.124.129:34871)
0929 22:58:32.818699 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:32.818703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:32.818712 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:32.818748 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:32.818750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:32.818765 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:32.818848 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:32.818981 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.819738 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.821454 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:32.822157 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:32.822626 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:32.822690 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:32.822712 (+ 22us) server_negotiation.cc:299] Negotiation successful
0929 22:58:32.822750 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":77,"threads_started":1}
I20260929 22:58:32.823302 17853 tablet_service.cc:1467] Processing CreateTablet for tablet 59d3262fe63544fb911faa6157a3d120 (DEFAULT_TABLE table=test-table [id=b2ce880e9bbd42c18c3682b1280ed187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:32.823448 17719 tablet_service.cc:1467] Processing CreateTablet for tablet 59d3262fe63544fb911faa6157a3d120 (DEFAULT_TABLE table=test-table [id=b2ce880e9bbd42c18c3682b1280ed187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:32.823670 17853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d3262fe63544fb911faa6157a3d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:32.823784 17719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d3262fe63544fb911faa6157a3d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:32.826205 18067 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Bootstrap starting.
I20260929 22:58:32.826432 18068 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Bootstrap starting.
I20260929 22:58:32.826596 17987 tablet_service.cc:1467] Processing CreateTablet for tablet 59d3262fe63544fb911faa6157a3d120 (DEFAULT_TABLE table=test-table [id=b2ce880e9bbd42c18c3682b1280ed187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:32.826826 17987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d3262fe63544fb911faa6157a3d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:32.826958 18067 tablet_bootstrap.cc:654] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:32.827229 18068 tablet_bootstrap.cc:654] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:32.827556 18067 log.cc:824] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:32.827819 18068 log.cc:824] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:32.828408 18067 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: No bootstrap required, opened a new log
I20260929 22:58:32.828481 18067 ts_tablet_manager.cc:1397] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:32.828600 18068 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: No bootstrap required, opened a new log
I20260929 22:58:32.828696 18068 ts_tablet_manager.cc:1397] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:32.829911 18071 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Bootstrap starting.
I20260929 22:58:32.830466 18071 tablet_bootstrap.cc:654] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:32.830536 18067 raft_consensus.cc:348] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.830590 18068 raft_consensus.cc:348] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.830722 18067 raft_consensus.cc:374] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:32.830734 18068 raft_consensus.cc:374] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:32.830771 18068 raft_consensus.cc:729] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9b0a1c2e4f44cd92befbd99d6eee69, State: Initialized, Role: FOLLOWER
I20260929 22:58:32.830798 18067 raft_consensus.cc:729] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0318a2b101a04053872f2399dea0154d, State: Initialized, Role: FOLLOWER
I20260929 22:58:32.830935 18067 consensus_queue.cc:260] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.830927 18068 consensus_queue.cc:260] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.831053 18071 log.cc:824] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:32.831203 18068 ts_tablet_manager.cc:1428] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:32.831296 18067 ts_tablet_manager.cc:1428] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:58:32.831300 17919 heartbeater.cc:503] Master 127.0.124.190:35659 was elected leader, sending a full tablet report...
I20260929 22:58:32.831218 17785 heartbeater.cc:503] Master 127.0.124.190:35659 was elected leader, sending a full tablet report...
I20260929 22:58:32.832062 18071 tablet_bootstrap.cc:492] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: No bootstrap required, opened a new log
I20260929 22:58:32.832163 18071 ts_tablet_manager.cc:1397] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:32.833575 18071 raft_consensus.cc:348] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.833724 18071 raft_consensus.cc:374] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:32.833784 18071 raft_consensus.cc:729] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9bb54974bf4e3989ac4fd4b24c6809, State: Initialized, Role: FOLLOWER
I20260929 22:58:32.833894 18071 consensus_queue.cc:260] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:32.834193 18053 heartbeater.cc:503] Master 127.0.124.190:35659 was elected leader, sending a full tablet report...
I20260929 22:58:32.834193 18071 ts_tablet_manager.cc:1428] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260929 22:58:32.884048 17920 tablet.cc:2369] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:32.987603 17786 tablet.cc:2369] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:33.039753 18054 tablet.cc:2369] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:33.101925 18073 raft_consensus.cc:482] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:33.102044 18073 raft_consensus.cc:504] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:33.102350 18073 leader_election.cc:288] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e9b0a1c2e4f44cd92befbd99d6eee69 (127.0.124.129:34871), 9d9bb54974bf4e3989ac4fd4b24c6809 (127.0.124.131:35359)
I20260929 22:58:33.105124 18063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.102618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:35827 (local address 127.0.124.129:34871)
0929 22:58:33.102709 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.102712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.102722 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:33.102751 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.102752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.102762 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.102833 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.102995 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.103458 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.104444 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.104792 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.104872 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.104880 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.105031 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.105069 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260929 22:58:33.105123 17921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.102533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34871 (local address 127.0.124.130:35827)
0929 22:58:33.102590 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.102602 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.102659 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.102852 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.102853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.102855 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.102923 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.102925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.103557 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.103558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.104353 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.104355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.104867 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.104869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.104949 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.104952 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.105011 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.105052 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":26}
I20260929 22:58:33.105336 18076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.102653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:35359 (local address 127.0.124.130:43489)
0929 22:58:33.102800 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.102809 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.102850 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.102969 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.102970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.102971 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.103046 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.103047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.103656 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.103657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.104484 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.104486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.105048 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.105049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.105114 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.105117 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.105207 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.105241 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260929 22:58:33.105324 18066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.102759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:43489 (local address 127.0.124.131:35359)
0929 22:58:33.102825 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.102827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.102839 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:58:33.102912 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.102913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.102921 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.102959 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.103121 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.103570 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.104566 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.104925 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.105033 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.105041 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.105213 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.105247 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:58:33.105521 17734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d3262fe63544fb911faa6157a3d120" candidate_uuid: "0318a2b101a04053872f2399dea0154d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" is_pre_election: true
I20260929 22:58:33.105676 17734 raft_consensus.cc:2454] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0318a2b101a04053872f2399dea0154d in term 0.
I20260929 22:58:33.105803 18007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d3262fe63544fb911faa6157a3d120" candidate_uuid: "0318a2b101a04053872f2399dea0154d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" is_pre_election: true
I20260929 22:58:33.105959 17806 leader_election.cc:302] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0318a2b101a04053872f2399dea0154d, 3e9b0a1c2e4f44cd92befbd99d6eee69; no voters:
I20260929 22:58:33.105996 18007 raft_consensus.cc:2454] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0318a2b101a04053872f2399dea0154d in term 0.
I20260929 22:58:33.106105 18073 raft_consensus.cc:2781] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:33.106180 18073 raft_consensus.cc:482] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:33.106208 18073 raft_consensus.cc:3037] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.106877 18073 raft_consensus.cc:504] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:33.107005 18073 leader_election.cc:288] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [CANDIDATE]: Term 1 election: Requested vote from peers 3e9b0a1c2e4f44cd92befbd99d6eee69 (127.0.124.129:34871), 9d9bb54974bf4e3989ac4fd4b24c6809 (127.0.124.131:35359)
I20260929 22:58:33.107213 17734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d3262fe63544fb911faa6157a3d120" candidate_uuid: "0318a2b101a04053872f2399dea0154d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69"
I20260929 22:58:33.107239 18007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d3262fe63544fb911faa6157a3d120" candidate_uuid: "0318a2b101a04053872f2399dea0154d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809"
I20260929 22:58:33.107291 17734 raft_consensus.cc:3037] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.107322 18007 raft_consensus.cc:3037] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.108058 17734 raft_consensus.cc:2454] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0318a2b101a04053872f2399dea0154d in term 1.
I20260929 22:58:33.108184 18007 raft_consensus.cc:2454] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0318a2b101a04053872f2399dea0154d in term 1.
I20260929 22:58:33.108201 17806 leader_election.cc:302] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0318a2b101a04053872f2399dea0154d, 3e9b0a1c2e4f44cd92befbd99d6eee69; no voters:
I20260929 22:58:33.108409 18073 raft_consensus.cc:2781] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:33.108582 18073 raft_consensus.cc:686] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 1 LEADER]: Becoming Leader. State: Replica: 0318a2b101a04053872f2399dea0154d, State: Running, Role: LEADER
I20260929 22:58:33.108688 18073 consensus_queue.cc:237] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } }
I20260929 22:58:33.109562 17593 catalog_manager.cc:5495] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0318a2b101a04053872f2399dea0154d (127.0.124.130). New cstate: current_term: 1 leader_uuid: "0318a2b101a04053872f2399dea0154d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0318a2b101a04053872f2399dea0154d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 } health_report { overall_health: UNKNOWN } } }
I20260929 22:58:33.174304 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.171871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53532 (local address 127.0.124.130:35097)
0929 22:58:33.171933 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.171935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.171945 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:33.171992 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.171993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.172011 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.172086 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:33.172228 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.172765 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.173523 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.173715 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.173790 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.173961 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:33.174060 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:33.174155 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.174178 (+ 23us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.174197 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:58:33.176051 17734 raft_consensus.cc:1261] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69 [term 1 FOLLOWER]: Refusing update from remote peer 0318a2b101a04053872f2399dea0154d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:33.176051 18007 raft_consensus.cc:1261] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 1 FOLLOWER]: Refusing update from remote peer 0318a2b101a04053872f2399dea0154d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:33.176427 18073 consensus_queue.cc:1035] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9b0a1c2e4f44cd92befbd99d6eee69" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 34871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:33.176584 18077 consensus_queue.cc:1035] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9bb54974bf4e3989ac4fd4b24c6809" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 35359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:33.178797 18081 mvcc.cc:205] Tried to move back new op lower bound from 7334800233166430208 to 7334800232893722624. Current Snapshot: MvccSnapshot[applied={T|T < 7334800233166430208}]
I20260929 22:58:33.181003 17594 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:33.181114 17594 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:33.181847 17594 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa15810b6d149a786127e8c7dec5485: Sending DeleteTablet for 3 replicas of tablet 59d3262fe63544fb911faa6157a3d120
I20260929 22:58:33.182224 17987 tablet_service.cc:1514] Processing DeleteTablet for tablet 59d3262fe63544fb911faa6157a3d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:49316
I20260929 22:58:33.182243 17719 tablet_service.cc:1514] Processing DeleteTablet for tablet 59d3262fe63544fb911faa6157a3d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60636
I20260929 22:58:33.182435 17853 tablet_service.cc:1514] Processing DeleteTablet for tablet 59d3262fe63544fb911faa6157a3d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:53530
I20260929 22:58:33.182660 18091 tablet_replica.cc:330] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: stopping tablet replica
I20260929 22:58:33.182736 18090 tablet_replica.cc:330] T 59d3262fe63544fb911faa6157a3d120 P 3e9b0a1c2e4f44cd92befbd99d6eee69: stopping tablet replica
I20260929 22:58:33.182808 18091 raft_consensus.cc:2229] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:58:33.182930 18091 raft_consensus.cc:2258] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:33.183022 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17656
I20260929 22:58:33.183909 18091 ts_tablet_manager.cc:1905] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:33.186053 18091 ts_tablet_manager.cc:1918] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:33.186199 18091 log.cc:1196] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/59d3262fe63544fb911faa6157a3d120
I20260929 22:58:33.186525 18091 ts_tablet_manager.cc:1939] T 59d3262fe63544fb911faa6157a3d120 P 0318a2b101a04053872f2399dea0154d: Deleting consensus metadata
I20260929 22:58:33.186961 17579 catalog_manager.cc:4841] TS 0318a2b101a04053872f2399dea0154d (127.0.124.130:35097): tablet 59d3262fe63544fb911faa6157a3d120 (table test-table [id=b2ce880e9bbd42c18c3682b1280ed187]) successfully deleted
I20260929 22:58:33.188334 18089 tablet_replica.cc:330] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: stopping tablet replica
I20260929 22:58:33.188467 18089 raft_consensus.cc:2229] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:33.188586 18089 raft_consensus.cc:2258] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 22:58:33.188714 17578 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:34871 (error 108)
I20260929 22:58:33.189087 18089 ts_tablet_manager.cc:1905] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:33.189152 18062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.189002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:34871 (local address 127.0.0.1:60650)
0929 22:58:33.189064 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.189098 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:34871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260929 22:58:33.189249 17578 catalog_manager.cc:4584] TS 3e9b0a1c2e4f44cd92befbd99d6eee69 (127.0.124.129:34871): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 59d3262fe63544fb911faa6157a3d120: Network error: Client connection negotiation failed: client connection to 127.0.124.129:34871: connect: Connection refused (error 111)
I20260929 22:58:33.189373 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17790
I20260929 22:58:33.190899 18089 ts_tablet_manager.cc:1918] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:33.190958 18089 log.cc:1196] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/59d3262fe63544fb911faa6157a3d120
I20260929 22:58:33.191217 18089 ts_tablet_manager.cc:1939] T 59d3262fe63544fb911faa6157a3d120 P 9d9bb54974bf4e3989ac4fd4b24c6809: Deleting consensus metadata
I20260929 22:58:33.191609 17578 catalog_manager.cc:4841] TS 9d9bb54974bf4e3989ac4fd4b24c6809 (127.0.124.131:35359): tablet 59d3262fe63544fb911faa6157a3d120 (table test-table [id=b2ce880e9bbd42c18c3682b1280ed187]) successfully deleted
I20260929 22:58:33.195226 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17924
I20260929 22:58:33.199424 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 17562
2026-09-29T22:58:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2185 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-29T22:58:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:33Z Disabled control of system clock
I20260929 22:58:33.226507 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34545
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:33.304934 18096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:33.305140 18096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:33.305159 18096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:33.306213 18096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:33.306243 18096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:33.306255 18096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:33.306268 18096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:33.306279 18096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:33.307497 18096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34545
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:33.307672 18096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:33.307874 18096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:33.312414 18101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.312481 18096 server_base.cc:1034] running on GCE node
W20260929 22:58:33.312429 18102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.312429 18104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.312943 18096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:33.313215 18096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:33.314368 18096 hybrid_clock.cc:648] HybridClock initialized: now 1790722713314362 us; error 36 us; skew 500 ppm
I20260929 22:58:33.315481 18096 webserver.cc:460] Webserver started at http://127.0.124.190:33347/ using document root <none> and password file <none>
I20260929 22:58:33.315728 18096 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:33.315809 18096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:33.315945 18096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:33.316951 18096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "a24e85c8f16948a89d25e7bf2cf23e73"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "727db10a4dff1ac3987eb8ddbd83a996"
server_key_iv: "5d8d9287b2ca0891ed2d04b8c5687f64"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.317286 18096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "a24e85c8f16948a89d25e7bf2cf23e73"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "727db10a4dff1ac3987eb8ddbd83a996"
server_key_iv: "5d8d9287b2ca0891ed2d04b8c5687f64"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.318485 18096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:33.319175 18110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.319355 18096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:33.319446 18096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "a24e85c8f16948a89d25e7bf2cf23e73"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "727db10a4dff1ac3987eb8ddbd83a996"
server_key_iv: "5d8d9287b2ca0891ed2d04b8c5687f64"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.319527 18096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:33.333356 18096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:33.333647 18096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:33.333788 18096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:33.337774 18096 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:34545
I20260929 22:58:33.337809 18162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:34545 every 8 connection(s)
I20260929 22:58:33.338121 18096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:33.338999 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:33.340538 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18096
I20260929 22:58:33.340646 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:33.340835 498 external_mini_cluster.cc:1428] Setting key 58579b2067d530e9b25492f797a983bc
I20260929 22:58:33.341848 18163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: Bootstrap starting.
I20260929 22:58:33.342621 18163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:33.342936 18163 log.cc:824] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:33.343744 18163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: No bootstrap required, opened a new log
I20260929 22:58:33.346289 18163 raft_consensus.cc:348] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } }
I20260929 22:58:33.346503 18163 raft_consensus.cc:374] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:33.346557 18163 raft_consensus.cc:729] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a24e85c8f16948a89d25e7bf2cf23e73, State: Initialized, Role: FOLLOWER
I20260929 22:58:33.346686 18163 consensus_queue.cc:260] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } }
I20260929 22:58:33.346788 18163 raft_consensus.cc:388] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:33.346835 18163 raft_consensus.cc:482] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:33.346895 18163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.347062 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.341391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.0.124.190:34545)
0929 22:58:33.341606 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.341613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.341637 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:58:33.342089 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.342095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.342153 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.342298 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:33.342563 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.343494 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.344630 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.345241 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.345375 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.346142 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:33.346146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:33.346147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:33.346375 (+ 228us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:33.346418 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:33.346432 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:33.346521 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.346719 (+ 198us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.346818 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260929 22:58:33.347543 18163 raft_consensus.cc:504] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } }
I20260929 22:58:33.347662 18163 leader_election.cc:302] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a24e85c8f16948a89d25e7bf2cf23e73; no voters:
I20260929 22:58:33.347834 18163 leader_election.cc:288] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:33.347877 18168 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:33.348038 18168 raft_consensus.cc:686] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [term 1 LEADER]: Becoming Leader. State: Replica: a24e85c8f16948a89d25e7bf2cf23e73, State: Running, Role: LEADER
I20260929 22:58:33.348120 18163 sys_catalog.cc:564] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:33.348160 18168 consensus_queue.cc:237] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } }
I20260929 22:58:33.348568 18169 sys_catalog.cc:455] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } } }
I20260929 22:58:33.348580 18170 sys_catalog.cc:455] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a24e85c8f16948a89d25e7bf2cf23e73. Latest consensus state: current_term: 1 leader_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a24e85c8f16948a89d25e7bf2cf23e73" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34545 } } }
I20260929 22:58:33.348759 18169 sys_catalog.cc:458] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:33.348770 18170 sys_catalog.cc:458] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:33.349148 18177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:33.349610 18177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:33.351164 18177 catalog_manager.cc:1347] Generated new cluster ID: 80801985b8194f81bc119ade7c6246c5
I20260929 22:58:33.351207 18177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:33.358597 18177 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:33.359082 18177 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:33.362735 18177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: Generated new TSK 0
I20260929 22:58:33.362891 18177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:33.364104 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--builtin_ntp_servers=127.0.124.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:33.455024 18187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:33.455240 18187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:33.455276 18187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:33.456440 18187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:33.456502 18187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:33.456544 18187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:33.457875 18187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:33.458127 18187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:33.458403 18187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:33.464298 18192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.464294 18193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.464393 18195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.464630 18187 server_base.cc:1034] running on GCE node
I20260929 22:58:33.464864 18187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:33.465090 18187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:33.466244 18187 hybrid_clock.cc:648] HybridClock initialized: now 1790722713466232 us; error 29 us; skew 500 ppm
I20260929 22:58:33.467445 18187 webserver.cc:460] Webserver started at http://127.0.124.129:36061/ using document root <none> and password file <none>
I20260929 22:58:33.467713 18187 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:33.467784 18187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:33.467931 18187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:33.469066 18187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "bdde7a0a88284607948b9c20f916ec2d"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "7b0d4f0defa0ad1f98c04ed933429d79"
server_key_iv: "802352b03ab858875778d2e8f8d9dbf3"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.469410 18187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "bdde7a0a88284607948b9c20f916ec2d"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "7b0d4f0defa0ad1f98c04ed933429d79"
server_key_iv: "802352b03ab858875778d2e8f8d9dbf3"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.470746 18187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:33.471524 18201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.471692 18187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:33.471797 18187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "bdde7a0a88284607948b9c20f916ec2d"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "7b0d4f0defa0ad1f98c04ed933429d79"
server_key_iv: "802352b03ab858875778d2e8f8d9dbf3"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.471873 18187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:33.482662 18187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:33.482946 18187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:33.483099 18187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:33.483307 18187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:33.483625 18187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:33.483685 18187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.483724 18187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:33.483752 18187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.489884 18187 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:45859
I20260929 22:58:33.489928 18314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:45859 every 8 connection(s)
I20260929 22:58:33.490255 18187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:58:33.495452 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.490999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:53817 (local address 127.0.124.190:34545)
0929 22:58:33.491059 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.491066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.491285 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:58:33.491853 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.491854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.491866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.491925 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:33.492666 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.493166 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.494128 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.494327 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.494403 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.495157 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:33.495159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:33.495159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:33.495164 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:33.495178 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:33.495182 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:33.495262 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.495349 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.495375 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:58:33.495729 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.490984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34545 (local address 127.0.124.129:53817)
0929 22:58:33.491170 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.491202 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.491743 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.491993 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.492003 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.492011 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:33.492574 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.492580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.493261 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.493262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.494041 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.494043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.494409 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.494411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.494542 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.495031 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:33.495032 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:33.495058 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:33.495077 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:33.495262 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:33.495268 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:33.495271 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.495352 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.495446 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260929 22:58:33.496241 18315 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34545
I20260929 22:58:33.496327 18315 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:33.496541 18315 heartbeater.cc:511] Master 127.0.124.190:34545 requested a full tablet report, sending...
I20260929 22:58:33.496985 18127 ts_manager.cc:194] Registered new tserver with Master: bdde7a0a88284607948b9c20f916ec2d (127.0.124.129:45859)
I20260929 22:58:33.497570 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.129:53817
I20260929 22:58:33.499634 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18187
I20260929 22:58:33.499724 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:33.499888 498 external_mini_cluster.cc:1428] Setting key 51276527c58a8735b2ea64f31968b753
I20260929 22:58:33.500802 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--builtin_ntp_servers=127.0.124.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:33.579680 18318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:33.579874 18318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:33.579895 18318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:33.580986 18318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:33.581018 18318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:33.581043 18318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:33.582274 18318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:33.582448 18318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:33.582695 18318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:33.587548 18324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.587540 18323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.587570 18318 server_base.cc:1034] running on GCE node
W20260929 22:58:33.587543 18326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.588043 18318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:33.588341 18318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:33.589494 18318 hybrid_clock.cc:648] HybridClock initialized: now 1790722713589481 us; error 33 us; skew 500 ppm
I20260929 22:58:33.590773 18318 webserver.cc:460] Webserver started at http://127.0.124.130:43193/ using document root <none> and password file <none>
I20260929 22:58:33.591024 18318 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:33.591095 18318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:33.591249 18318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:33.592360 18318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "7fb90d408bfc42269c81957a002dc0bd"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "d6efed0c114f1d81a8ca8751a68a954f"
server_key_iv: "5963a6fc61449fa2607f67a98a4d0583"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.592710 18318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "7fb90d408bfc42269c81957a002dc0bd"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "d6efed0c114f1d81a8ca8751a68a954f"
server_key_iv: "5963a6fc61449fa2607f67a98a4d0583"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.593933 18318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:33.594599 18332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.594748 18318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:33.594832 18318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "7fb90d408bfc42269c81957a002dc0bd"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "d6efed0c114f1d81a8ca8751a68a954f"
server_key_iv: "5963a6fc61449fa2607f67a98a4d0583"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.594907 18318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:33.606693 18318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:33.606952 18318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:33.607091 18318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:33.607298 18318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:33.607591 18318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:33.607646 18318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.607683 18318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:33.607709 18318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.613436 18318 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:35669
I20260929 22:58:33.613479 18445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:35669 every 8 connection(s)
I20260929 22:58:33.613807 18318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:33.615319 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18318
I20260929 22:58:33.615419 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:33.615612 498 external_mini_cluster.cc:1428] Setting key fcc5c7263b6537ab82e0ad7b8ca0bf65
I20260929 22:58:33.616613 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--builtin_ntp_servers=127.0.124.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:58:33.619294 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.614550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:44035 (local address 127.0.124.190:34545)
0929 22:58:33.614618 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.614620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.614815 (+ 195us) server_negotiation.cc:407] Connection header received
0929 22:58:33.615337 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.615339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.615351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.615413 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:33.616232 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.616832 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.617908 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.618095 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.618160 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.619046 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:33.619047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:33.619048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:33.619052 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:33.619066 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:33.619070 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:33.619113 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.619212 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.619235 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:58:33.619560 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.614489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34545 (local address 127.0.124.130:44035)
0929 22:58:33.614704 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.614735 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.615235 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.615523 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.615526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.615534 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:33.616114 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.616120 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.616936 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.616937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.617818 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.617822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.618179 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.618180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.618341 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.618894 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:33.618894 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:33.618928 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:33.618955 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:33.619132 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:33.619138 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:33.619141 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.619207 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.619316 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260929 22:58:33.620159 18446 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34545
I20260929 22:58:33.620283 18446 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:33.620494 18446 heartbeater.cc:511] Master 127.0.124.190:34545 requested a full tablet report, sending...
I20260929 22:58:33.620862 18127 ts_manager.cc:194] Registered new tserver with Master: 7fb90d408bfc42269c81957a002dc0bd (127.0.124.130:35669)
I20260929 22:58:33.621243 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.130:44035
W20260929 22:58:33.696316 18449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:33.696535 18449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:33.696573 18449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:33.697829 18449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:33.697889 18449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:33.697932 18449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:33.699326 18449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:34545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:33.699608 18449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:33.699889 18449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:33.704722 18454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.704710 18457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:33.704770 18455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:33.705077 18449 server_base.cc:1034] running on GCE node
I20260929 22:58:33.705240 18449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:33.705432 18449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:33.706564 18449 hybrid_clock.cc:648] HybridClock initialized: now 1790722713706552 us; error 23 us; skew 500 ppm
I20260929 22:58:33.707768 18449 webserver.cc:460] Webserver started at http://127.0.124.131:42231/ using document root <none> and password file <none>
I20260929 22:58:33.708012 18449 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:33.708060 18449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:33.708271 18449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:33.709283 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "967ba7eb66bf4403b9fa11b2be29eb94"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "c0233dcdff15f6bcd71195642f9c7f43"
server_key_iv: "073fc906667b9a917f915925144477e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.709625 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "967ba7eb66bf4403b9fa11b2be29eb94"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "c0233dcdff15f6bcd71195642f9c7f43"
server_key_iv: "073fc906667b9a917f915925144477e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.710857 18449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:33.711597 18463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.711786 18449 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:33.711871 18449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "967ba7eb66bf4403b9fa11b2be29eb94"
format_stamp: "Formatted at 2026-09-29 22:58:33 on dist-test-slave-512q"
server_key: "c0233dcdff15f6bcd71195642f9c7f43"
server_key_iv: "073fc906667b9a917f915925144477e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:33.711939 18449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:33.722355 18449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:33.722641 18449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:33.722800 18449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:33.723029 18449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:33.723346 18449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:33.723398 18449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.723438 18449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:33.723467 18449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:33.728905 18449 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:42489
I20260929 22:58:33.728981 18576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:42489 every 8 connection(s)
I20260929 22:58:33.729305 18449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:58:33.731448 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18449
I20260929 22:58:33.731554 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:33.731748 498 external_mini_cluster.cc:1428] Setting key ea0917e7d53fdc96fd3bbf4e05b65569
I20260929 22:58:33.734836 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.730085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:47341 (local address 127.0.124.190:34545)
0929 22:58:33.730161 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.730162 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.730392 (+ 230us) server_negotiation.cc:407] Connection header received
0929 22:58:33.730976 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.730977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.730990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.731035 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:33.731775 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.732525 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.733502 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.733712 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.733793 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.734575 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:33.734577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:33.734577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:33.734582 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:33.734596 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:33.734599 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:33.734647 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.734735 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.734760 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:58:33.735049 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.730074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34545 (local address 127.0.124.131:47341)
0929 22:58:33.730275 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.730305 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.730854 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.731130 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.731134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.731142 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:33.731674 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.731680 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.732611 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.732612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.733384 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.733386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.733802 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.733804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.733935 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.734375 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:33.734375 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:33.734401 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:33.734487 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:33.734646 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:33.734651 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:33.734654 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.734738 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.734834 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260929 22:58:33.735553 18577 heartbeater.cc:347] Connected to a master server at 127.0.124.190:34545
I20260929 22:58:33.735638 18577 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:33.735805 18577 heartbeater.cc:511] Master 127.0.124.190:34545 requested a full tablet report, sending...
I20260929 22:58:33.736159 18127 ts_manager.cc:194] Registered new tserver with Master: 967ba7eb66bf4403b9fa11b2be29eb94 (127.0.124.131:42489)
I20260929 22:58:33.736549 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.131:47341
I20260929 22:58:33.743508 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:33.747427 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.744903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37540 (local address 127.0.124.190:34545)
0929 22:58:33.744980 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.744982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.745035 (+ 53us) server_negotiation.cc:407] Connection header received
0929 22:58:33.745088 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.745089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.745096 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.745141 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:33.745287 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.745706 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.746384 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.746550 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.746595 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.747242 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:33.747243 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:33.747243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:33.747247 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:33.747255 (+ 8us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:33.747258 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:33.747293 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.747329 (+ 36us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.747343 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260929 22:58:33.749169 18127 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:33.750761 18127 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:33.757153 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.752958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35669 (local address 127.0.0.1:46708)
0929 22:58:33.753118 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.753164 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.753235 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.753435 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.753438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.753441 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.753499 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.753500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.755148 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.755150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.756028 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.756030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.756897 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.756898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.756972 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.756986 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.757034 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.757086 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":3,"thread_start_us":79,"threads_started":1}
I20260929 22:58:33.757427 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.753332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45859 (local address 127.0.0.1:51418)
0929 22:58:33.753494 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.753504 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.753550 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.754011 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.754012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.754014 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.754062 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.754063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.754928 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.754929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.756233 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.756235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.757089 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.757090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.757159 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.757164 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.757206 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.757341 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":89,"spinlock_wait_cycles":82816,"thread_start_us":73,"threads_started":1}
I20260929 22:58:33.757486 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.753061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46708 (local address 127.0.124.130:35669)
0929 22:58:33.753237 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.753242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.753253 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:58:33.753319 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.753322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.753337 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.753432 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.753865 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.755042 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.756107 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.756796 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.757263 (+ 467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.757349 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.757371 (+ 22us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.757407 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260929 22:58:33.757486 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.753671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51418 (local address 127.0.124.129:45859)
0929 22:58:33.753830 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.753834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.753844 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:33.753882 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.753884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.753900 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.754123 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.754170 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.754828 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.756299 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.757004 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.757079 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.757166 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.757368 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.757409 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260929 22:58:33.757647 18587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.753179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:42489 (local address 127.0.0.1:39982)
0929 22:58:33.753286 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.753296 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.753342 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.753921 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.753922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.753924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.753964 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.753966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.755182 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.755183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.756502 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.756503 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.757337 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.757338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.757393 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.757396 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.757425 (+ 29us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.757463 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":34,"thread_start_us":63,"threads_started":1}
I20260929 22:58:33.758092 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.753597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39982 (local address 127.0.124.131:42489)
0929 22:58:33.753756 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.753760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.753770 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:33.753805 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.753807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.753822 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.754046 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.754095 (+ 49us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.755109 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.756577 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.757135 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.757834 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.757934 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.757960 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.758003 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260929 22:58:33.758148 18380 tablet_service.cc:1467] Processing CreateTablet for tablet 3c6f1725c20749daaf971e5917157f9e (DEFAULT_TABLE table=test-table [id=cd30632971684af8a1a62c2571017695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:33.758148 18249 tablet_service.cc:1467] Processing CreateTablet for tablet 3c6f1725c20749daaf971e5917157f9e (DEFAULT_TABLE table=test-table [id=cd30632971684af8a1a62c2571017695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:33.758488 18249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c6f1725c20749daaf971e5917157f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:33.758488 18380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c6f1725c20749daaf971e5917157f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:33.758670 18511 tablet_service.cc:1467] Processing CreateTablet for tablet 3c6f1725c20749daaf971e5917157f9e (DEFAULT_TABLE table=test-table [id=cd30632971684af8a1a62c2571017695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:33.758992 18511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c6f1725c20749daaf971e5917157f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:33.761610 18591 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Bootstrap starting.
I20260929 22:58:33.761895 18592 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: Bootstrap starting.
I20260929 22:58:33.762274 18591 tablet_bootstrap.cc:654] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:33.762462 18592 tablet_bootstrap.cc:654] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:33.762588 18591 log.cc:824] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:33.762786 18592 log.cc:824] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:33.763114 18593 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Bootstrap starting.
I20260929 22:58:33.763329 18591 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: No bootstrap required, opened a new log
I20260929 22:58:33.763420 18591 ts_tablet_manager.cc:1397] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:33.763516 18592 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: No bootstrap required, opened a new log
I20260929 22:58:33.763582 18592 ts_tablet_manager.cc:1397] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:33.763718 18593 tablet_bootstrap.cc:654] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:33.764022 18593 log.cc:824] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:33.764786 18593 tablet_bootstrap.cc:492] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: No bootstrap required, opened a new log
I20260929 22:58:33.764853 18593 ts_tablet_manager.cc:1397] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:58:33.765720 18591 raft_consensus.cc:348] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.765870 18591 raft_consensus.cc:374] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:33.765913 18591 raft_consensus.cc:729] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 967ba7eb66bf4403b9fa11b2be29eb94, State: Initialized, Role: FOLLOWER
I20260929 22:58:33.766055 18591 consensus_queue.cc:260] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.766319 18591 ts_tablet_manager.cc:1428] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:58:33.766201 18592 raft_consensus.cc:348] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.766341 18577 heartbeater.cc:503] Master 127.0.124.190:34545 was elected leader, sending a full tablet report...
I20260929 22:58:33.766362 18592 raft_consensus.cc:374] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:33.766398 18592 raft_consensus.cc:729] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdde7a0a88284607948b9c20f916ec2d, State: Initialized, Role: FOLLOWER
I20260929 22:58:33.766505 18592 consensus_queue.cc:260] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.766757 18592 ts_tablet_manager.cc:1428] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:58:33.766868 18315 heartbeater.cc:503] Master 127.0.124.190:34545 was elected leader, sending a full tablet report...
I20260929 22:58:33.767598 18593 raft_consensus.cc:348] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.767711 18593 raft_consensus.cc:374] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:33.767731 18593 raft_consensus.cc:729] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb90d408bfc42269c81957a002dc0bd, State: Initialized, Role: FOLLOWER
I20260929 22:58:33.767829 18593 consensus_queue.cc:260] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.768074 18593 ts_tablet_manager.cc:1428] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:58:33.768092 18446 heartbeater.cc:503] Master 127.0.124.190:34545 was elected leader, sending a full tablet report...
W20260929 22:58:33.864368 18447 tablet.cc:2369] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:33.907557 18598 raft_consensus.cc:482] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:33.907675 18598 raft_consensus.cc:504] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.908008 18598 leader_election.cc:288] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fb90d408bfc42269c81957a002dc0bd (127.0.124.130:35669), 967ba7eb66bf4403b9fa11b2be29eb94 (127.0.124.131:42489)
I20260929 22:58:33.911875 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.908459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:54639 (local address 127.0.124.131:42489)
0929 22:58:33.908521 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.908523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.908565 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:58:33.908626 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.908626 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.908635 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.908703 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.908848 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.909524 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.910978 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.911520 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.911598 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.911605 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.911768 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.911806 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:58:33.911875 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.908329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:60745 (local address 127.0.124.130:35669)
0929 22:58:33.908397 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.908400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.908411 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:58:33.908446 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.908447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.908455 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.908550 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:33.908715 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.909470 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.910980 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.911521 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.911598 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.911605 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.911768 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.911806 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:58:33.911887 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.908224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:35669 (local address 127.0.124.129:60745)
0929 22:58:33.908283 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.908296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.908342 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.908557 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.908558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.908560 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.908634 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.908636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.909571 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.909572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.910889 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.910891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.911605 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.911606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.911690 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.911693 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.911749 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.911795 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":39}
I20260929 22:58:33.911892 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.908366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:42489 (local address 127.0.124.129:54639)
0929 22:58:33.908512 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.908521 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:33.908572 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:33.908724 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:33.908725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:33.908727 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:33.908786 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.908787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.909595 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.909595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.910889 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:33.910891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.911606 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.911607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:33.911694 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.911697 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:33.911749 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:58:33.911794 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":62,"thread_start_us":90,"threads_started":1}
I20260929 22:58:33.912288 18400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c6f1725c20749daaf971e5917157f9e" candidate_uuid: "bdde7a0a88284607948b9c20f916ec2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fb90d408bfc42269c81957a002dc0bd" is_pre_election: true
I20260929 22:58:33.912434 18400 raft_consensus.cc:2454] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdde7a0a88284607948b9c20f916ec2d in term 0.
I20260929 22:58:33.912505 18531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c6f1725c20749daaf971e5917157f9e" candidate_uuid: "bdde7a0a88284607948b9c20f916ec2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" is_pre_election: true
I20260929 22:58:33.912665 18531 raft_consensus.cc:2454] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdde7a0a88284607948b9c20f916ec2d in term 0.
I20260929 22:58:33.912694 18202 leader_election.cc:302] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fb90d408bfc42269c81957a002dc0bd, bdde7a0a88284607948b9c20f916ec2d; no voters:
I20260929 22:58:33.912827 18598 raft_consensus.cc:2781] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:33.912879 18598 raft_consensus.cc:482] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:33.912904 18598 raft_consensus.cc:3037] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.913573 18598 raft_consensus.cc:504] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.913695 18598 leader_election.cc:288] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [CANDIDATE]: Term 1 election: Requested vote from peers 7fb90d408bfc42269c81957a002dc0bd (127.0.124.130:35669), 967ba7eb66bf4403b9fa11b2be29eb94 (127.0.124.131:42489)
I20260929 22:58:33.913823 18400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c6f1725c20749daaf971e5917157f9e" candidate_uuid: "bdde7a0a88284607948b9c20f916ec2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fb90d408bfc42269c81957a002dc0bd"
I20260929 22:58:33.913894 18531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c6f1725c20749daaf971e5917157f9e" candidate_uuid: "bdde7a0a88284607948b9c20f916ec2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "967ba7eb66bf4403b9fa11b2be29eb94"
I20260929 22:58:33.913906 18400 raft_consensus.cc:3037] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.913966 18531 raft_consensus.cc:3037] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:33.914839 18531 raft_consensus.cc:2454] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdde7a0a88284607948b9c20f916ec2d in term 1.
I20260929 22:58:33.914839 18400 raft_consensus.cc:2454] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdde7a0a88284607948b9c20f916ec2d in term 1.
I20260929 22:58:33.914991 18202 leader_election.cc:302] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 967ba7eb66bf4403b9fa11b2be29eb94, bdde7a0a88284607948b9c20f916ec2d; no voters:
I20260929 22:58:33.915110 18598 raft_consensus.cc:2781] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:33.915256 18598 raft_consensus.cc:686] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [term 1 LEADER]: Becoming Leader. State: Replica: bdde7a0a88284607948b9c20f916ec2d, State: Running, Role: LEADER
I20260929 22:58:33.915351 18598 consensus_queue.cc:237] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } }
I20260929 22:58:33.916318 18125 catalog_manager.cc:5495] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d reported cstate change: term changed from 0 to 1, leader changed from <none> to bdde7a0a88284607948b9c20f916ec2d (127.0.124.129). New cstate: current_term: 1 leader_uuid: "bdde7a0a88284607948b9c20f916ec2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdde7a0a88284607948b9c20f916ec2d" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260929 22:58:33.936775 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.934406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51426 (local address 127.0.124.129:45859)
0929 22:58:33.934468 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:33.934470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:33.934482 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:58:33.934525 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:33.934526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:33.934551 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:33.934624 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:33.934758 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.935214 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.935969 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:33.936162 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:33.936258 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:33.936429 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:33.936522 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:33.936606 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:33.936657 (+ 51us) server_negotiation.cc:299] Negotiation successful
0929 22:58:33.936676 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:58:33.938447 18531 raft_consensus.cc:1261] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 1 FOLLOWER]: Refusing update from remote peer bdde7a0a88284607948b9c20f916ec2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:33.938470 18400 raft_consensus.cc:1261] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 1 FOLLOWER]: Refusing update from remote peer bdde7a0a88284607948b9c20f916ec2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:33.938834 18598 consensus_queue.cc:1035] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "967ba7eb66bf4403b9fa11b2be29eb94" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:33.938956 18601 consensus_queue.cc:1035] T 3c6f1725c20749daaf971e5917157f9e P bdde7a0a88284607948b9c20f916ec2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fb90d408bfc42269c81957a002dc0bd" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:33.941321 18605 mvcc.cc:205] Tried to move back new op lower bound from 7334800236289363968 to 7334800236198014976. Current Snapshot: MvccSnapshot[applied={T|T < 7334800236289363968}]
I20260929 22:58:33.941115 18604 mvcc.cc:205] Tried to move back new op lower bound from 7334800236289363968 to 7334800236198014976. Current Snapshot: MvccSnapshot[applied={T|T < 7334800236289363968}]
I20260929 22:58:33.943491 18127 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:33.943575 18127 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:33.944308 18127 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a24e85c8f16948a89d25e7bf2cf23e73: Sending DeleteTablet for 3 replicas of tablet 3c6f1725c20749daaf971e5917157f9e
I20260929 22:58:33.944617 18380 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c6f1725c20749daaf971e5917157f9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='slave'} at 127.0.0.1:46708
I20260929 22:58:33.944660 18511 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c6f1725c20749daaf971e5917157f9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='slave'} at 127.0.0.1:39982
I20260929 22:58:33.944785 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18187
I20260929 22:58:33.944882 18249 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c6f1725c20749daaf971e5917157f9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:33 UTC) from {username='slave'} at 127.0.0.1:51418
I20260929 22:58:33.945428 18614 tablet_replica.cc:330] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: stopping tablet replica
I20260929 22:58:33.945549 18614 raft_consensus.cc:2229] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:33.945684 18614 raft_consensus.cc:2258] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:33.946846 18614 ts_tablet_manager.cc:1905] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:33.948823 18614 ts_tablet_manager.cc:1918] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:33.948899 18614 log.cc:1196] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/3c6f1725c20749daaf971e5917157f9e
I20260929 22:58:33.949146 18614 ts_tablet_manager.cc:1939] T 3c6f1725c20749daaf971e5917157f9e P 7fb90d408bfc42269c81957a002dc0bd: Deleting consensus metadata
I20260929 22:58:33.949543 18111 catalog_manager.cc:4841] TS 7fb90d408bfc42269c81957a002dc0bd (127.0.124.130:35669): tablet 3c6f1725c20749daaf971e5917157f9e (table test-table [id=cd30632971684af8a1a62c2571017695]) successfully deleted
W20260929 22:58:33.951367 18111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:45859 (error 108)
I20260929 22:58:33.951588 18615 tablet_replica.cc:330] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: stopping tablet replica
I20260929 22:58:33.951709 18615 raft_consensus.cc:2229] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:33.951807 18615 raft_consensus.cc:2258] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:33.951882 18587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:33.951754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:45859 (local address 127.0.0.1:51442)
0929 22:58:33.951814 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:33.951852 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 22:58:33.952014 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18318
W20260929 22:58:33.951990 18111 catalog_manager.cc:4584] TS bdde7a0a88284607948b9c20f916ec2d (127.0.124.129:45859): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c6f1725c20749daaf971e5917157f9e: Network error: Client connection negotiation failed: client connection to 127.0.124.129:45859: connect: Connection refused (error 111)
I20260929 22:58:33.952908 18615 ts_tablet_manager.cc:1905] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:33.954206 18615 ts_tablet_manager.cc:1918] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:33.954286 18615 log.cc:1196] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/3c6f1725c20749daaf971e5917157f9e
I20260929 22:58:33.954512 18615 ts_tablet_manager.cc:1939] T 3c6f1725c20749daaf971e5917157f9e P 967ba7eb66bf4403b9fa11b2be29eb94: Deleting consensus metadata
I20260929 22:58:33.954883 18111 catalog_manager.cc:4841] TS 967ba7eb66bf4403b9fa11b2be29eb94 (127.0.124.131:42489): tablet 3c6f1725c20749daaf971e5917157f9e (table test-table [id=cd30632971684af8a1a62c2571017695]) successfully deleted
I20260929 22:58:33.957602 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18449
I20260929 22:58:33.962684 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18096
2026-09-29T22:58:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (762 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:34 dist-test-slave-512q krb5kdc[18619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:34 dist-test-slave-512q krb5kdc[18619](info): set up 2 sockets
Sep 29 22:58:34 dist-test-slave-512q krb5kdc[18619](info): commencing operation
krb5kdc: starting...
W20260929 22:58:34.994688 498 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:35.104513 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36957
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:39473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:36957
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:35.183717 18632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:35.183933 18632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:35.183966 18632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:35.185077 18632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:35.185142 18632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:35.185165 18632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:35.185186 18632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:35.185213 18632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:35.186610 18632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:39473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:36957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:36957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:35.186867 18632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:35.187078 18632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:35.191744 18640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.191756 18637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.191753 18638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:35.192020 18632 server_base.cc:1034] running on GCE node
I20260929 22:58:35.192312 18632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:35.192587 18632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:35.193739 18632 hybrid_clock.cc:648] HybridClock initialized: now 1790722715193719 us; error 35 us; skew 500 ppm
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:35.196362 18632 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:35.196832 18632 webserver.cc:460] Webserver started at http://127.0.124.190:37057/ using document root <none> and password file <none>
I20260929 22:58:35.197067 18632 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:35.197110 18632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:35.197247 18632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:35.198259 18632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "8d23b0731a354aa8bc40a3802a8ef808"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "42692936ae7d2a74b8626f6bc8216238"
server_key_iv: "cb9df5c96ca0e88ceaad0730c6b7d1dd"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.198603 18632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "8d23b0731a354aa8bc40a3802a8ef808"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "42692936ae7d2a74b8626f6bc8216238"
server_key_iv: "cb9df5c96ca0e88ceaad0730c6b7d1dd"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.199855 18632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:58:35.200603 18647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.200763 18632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.200860 18632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "8d23b0731a354aa8bc40a3802a8ef808"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "42692936ae7d2a74b8626f6bc8216238"
server_key_iv: "cb9df5c96ca0e88ceaad0730c6b7d1dd"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.200939 18632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:35.207888 18632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:35.210115 18632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:35.210273 18632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:35.214221 18632 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:36957
I20260929 22:58:35.214263 18699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:36957 every 8 connection(s)
I20260929 22:58:35.214598 18632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:35.215385 18700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:35.217581 18700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: Bootstrap starting.
I20260929 22:58:35.218078 18700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:35.218298 18700 log.cc:824] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:35.218605 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18632
I20260929 22:58:35.218706 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:35.218897 498 external_mini_cluster.cc:1428] Setting key 6843031c8457005e92484541e20b4812
I20260929 22:58:35.219118 18700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: No bootstrap required, opened a new log
I20260929 22:58:35.220950 18700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } }
I20260929 22:58:35.221104 18700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:35.221140 18700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d23b0731a354aa8bc40a3802a8ef808, State: Initialized, Role: FOLLOWER
I20260929 22:58:35.221302 18700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } }
I20260929 22:58:35.221393 18700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:35.221426 18700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:35.221477 18700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:35.222399 18700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } }
I20260929 22:58:35.222483 18700 leader_election.cc:302] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d23b0731a354aa8bc40a3802a8ef808; no voters:
I20260929 22:58:35.222678 18700 leader_election.cc:288] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:35.222699 18705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:35.222810 18705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [term 1 LEADER]: Becoming Leader. State: Replica: 8d23b0731a354aa8bc40a3802a8ef808, State: Running, Role: LEADER
I20260929 22:58:35.222934 18700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:35.222949 18705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } }
I20260929 22:58:35.223341 18707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d23b0731a354aa8bc40a3802a8ef808. Latest consensus state: current_term: 1 leader_uuid: "8d23b0731a354aa8bc40a3802a8ef808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } } }
I20260929 22:58:35.223417 18707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:35.223645 18706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d23b0731a354aa8bc40a3802a8ef808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d23b0731a354aa8bc40a3802a8ef808" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 36957 } } }
I20260929 22:58:35.223966 18706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:35.224287 18711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:35.224813 18711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:35.226266 18711 catalog_manager.cc:1347] Generated new cluster ID: 10cf5eee036f4dedb54c2e35e303243b
I20260929 22:58:35.226318 18711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:35.234603 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.219469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36850 (local address 127.0.124.190:36957)
0929 22:58:35.219604 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.219612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.219651 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:58:35.220938 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.220944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.220989 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.221114 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:35.221887 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.222926 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.224023 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.224681 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.224813 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.231039 (+ 6226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:35.231043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:35.231043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:35.231055 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:35.232982 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.233356 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.233360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.233360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.233499 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.233707 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.233708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.233708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.234021 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:35.234169 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.234265 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.234398 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":64,"threads_started":1}
I20260929 22:58:35.246716 18711 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:35.247219 18711 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:35.251549 18711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: Generated new TSK 0
I20260929 22:58:35.251754 18711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:58:35.279290 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:39473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:35.359100 18726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:35.359301 18726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:35.359325 18726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:35.360453 18726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:35.360492 18726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:35.360519 18726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:35.361928 18726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:39473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:35.362099 18726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:35.362274 18726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:35.367028 18731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.367146 18732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.367188 18734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:35.367273 18726 server_base.cc:1034] running on GCE node
I20260929 22:58:35.367478 18726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:35.367688 18726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:35.368821 18726 hybrid_clock.cc:648] HybridClock initialized: now 1790722715368810 us; error 28 us; skew 500 ppm
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:35.371289 18726 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:58:35.371740 18726 webserver.cc:460] Webserver started at http://127.0.124.129:33689/ using document root <none> and password file <none>
I20260929 22:58:35.371971 18726 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:35.372037 18726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:35.372195 18726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:35.373236 18726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "44c38d7fe4b14502b1ba39caecddc63f"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "1e5164e92725cec293e0d3492f3f24d2"
server_key_iv: "e4887bc6f2121f2fc19c5eb4415be16d"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.373524 18726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "44c38d7fe4b14502b1ba39caecddc63f"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "1e5164e92725cec293e0d3492f3f24d2"
server_key_iv: "e4887bc6f2121f2fc19c5eb4415be16d"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.374711 18726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:35.375348 18741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.375520 18726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:35.375617 18726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "44c38d7fe4b14502b1ba39caecddc63f"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "1e5164e92725cec293e0d3492f3f24d2"
server_key_iv: "e4887bc6f2121f2fc19c5eb4415be16d"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.375700 18726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:35.396404 18726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:35.398779 18726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:35.398943 18726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:35.399197 18726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:35.399513 18726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:35.399566 18726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.399602 18726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:35.399636 18726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.405485 18726 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:35467
I20260929 22:58:35.405530 18854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:35467 every 8 connection(s)
I20260929 22:58:35.405853 18726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:35.413743 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18726
I20260929 22:58:35.413872 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:35.414110 498 external_mini_cluster.cc:1428] Setting key 347b4ec30d0fe4e8b9caf96305150ef8
I20260929 22:58:35.414897 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.406582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41845 (local address 127.0.124.190:36957)
0929 22:58:35.406623 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.406626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.406818 (+ 192us) server_negotiation.cc:407] Connection header received
0929 22:58:35.407739 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.407740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.407756 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.407803 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:35.408491 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.408983 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.409948 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.410178 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.410283 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.412334 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:35.412336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:35.412336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:35.412346 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:35.413499 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.413926 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.413927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.413927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.413996 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.414268 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.414269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.414269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.414385 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:35.414461 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.414722 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.414809 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:58:35.415084 18857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.406538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36957 (local address 127.0.124.129:41845)
0929 22:58:35.406692 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.406734 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.407615 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.407887 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.407891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.408146 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:35.408400 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.408405 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.409085 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.409085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.409861 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.409864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.410293 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.410294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.410414 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.410840 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:35.410847 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:35.412178 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:35.413611 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.413617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.413620 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.413831 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.414075 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.414076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.414076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.414213 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.414452 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:35.414458 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:35.414592 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.414690 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.414837 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260929 22:58:35.415674 18855 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36957
I20260929 22:58:35.415781 18855 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:35.415949 18855 heartbeater.cc:511] Master 127.0.124.190:36957 requested a full tablet report, sending...
I20260929 22:58:35.416585 18664 ts_manager.cc:194] Registered new tserver with Master: 44c38d7fe4b14502b1ba39caecddc63f (127.0.124.129:35467)
I20260929 22:58:35.417492 18664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:41845
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:58:35.439037 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:39473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:35.519498 18860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:35.519686 18860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:35.519709 18860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:35.520787 18860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:35.520819 18860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:35.520844 18860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:35.522193 18860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:39473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:35.522367 18860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:35.522532 18860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:35.527546 18866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.527554 18865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.527563 18868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:35.527745 18860 server_base.cc:1034] running on GCE node
I20260929 22:58:35.527985 18860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:35.528246 18860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:35.529408 18860 hybrid_clock.cc:648] HybridClock initialized: now 1790722715529376 us; error 31 us; skew 500 ppm
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:35.531827 18860 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:58:35.532320 18860 webserver.cc:460] Webserver started at http://127.0.124.130:35025/ using document root <none> and password file <none>
I20260929 22:58:35.532534 18860 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:35.532595 18860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:35.532729 18860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:35.533699 18860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "bb7aa440c318473a90a1181a1f25c15e"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "3d4f80420a4ead9da085977ee9aa558d"
server_key_iv: "f68b334fc643429919ecbab0f7f7ffd8"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.534044 18860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "bb7aa440c318473a90a1181a1f25c15e"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "3d4f80420a4ead9da085977ee9aa558d"
server_key_iv: "f68b334fc643429919ecbab0f7f7ffd8"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.535286 18860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:35.535967 18875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.536146 18860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:35.536257 18860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "bb7aa440c318473a90a1181a1f25c15e"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "3d4f80420a4ead9da085977ee9aa558d"
server_key_iv: "f68b334fc643429919ecbab0f7f7ffd8"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.536348 18860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:35.546710 18860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:35.548924 18860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:35.549027 18860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:35.549189 18860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:35.549415 18860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:35.549444 18860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.549464 18860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:35.549476 18860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.555171 18860 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:42013
I20260929 22:58:35.555208 18988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:42013 every 8 connection(s)
I20260929 22:58:35.555498 18860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:35.563568 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18860
I20260929 22:58:35.563668 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:35.563859 498 external_mini_cluster.cc:1428] Setting key 1765aa68206487b78aafbd54c3807fa7
I20260929 22:58:35.564667 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.556232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:58461 (local address 127.0.124.190:36957)
0929 22:58:35.556302 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.556304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.556457 (+ 153us) server_negotiation.cc:407] Connection header received
0929 22:58:35.557375 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.557376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.557387 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.557438 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:35.558001 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.558531 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.559511 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.559736 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.559818 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.561825 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:35.561826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:35.561826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:35.561832 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:35.563199 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.563595 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.563596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.563597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.563676 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.563932 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.563933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.563933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.564074 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:35.564167 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.564484 (+ 317us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.564568 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:58:35.564848 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.556183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36957 (local address 127.0.124.130:58461)
0929 22:58:35.556341 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.556382 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.557269 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.557521 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.557524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.557745 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:35.557911 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.557914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.558623 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.558624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.559407 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.559409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.559828 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.559829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.559962 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.560436 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:35.560443 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:35.561741 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:35.563268 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.563273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.563275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.563515 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.563752 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.563753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.563753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.563856 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.564169 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:35.564176 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:35.564353 (+ 177us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.564462 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.564615 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260929 22:58:35.565297 18989 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36957
I20260929 22:58:35.565371 18989 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:35.565553 18989 heartbeater.cc:511] Master 127.0.124.190:36957 requested a full tablet report, sending...
I20260929 22:58:35.565924 18664 ts_manager.cc:194] Registered new tserver with Master: bb7aa440c318473a90a1181a1f25c15e (127.0.124.130:42013)
I20260929 22:58:35.566298 18664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:58461
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:58:35.586783 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:39473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:35.665632 18994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:35.665819 18994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:35.665863 18994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:35.666947 18994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:35.666986 18994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:35.667011 18994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:35.668447 18994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:39473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:35.668614 18994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:35.668769 18994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:35.673473 19000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.673480 18999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:35.673514 19002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:35.673795 18994 server_base.cc:1034] running on GCE node
I20260929 22:58:35.674037 18994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:35.674283 18994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:35.675438 18994 hybrid_clock.cc:648] HybridClock initialized: now 1790722715675428 us; error 40 us; skew 500 ppm
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:35.677836 18994 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:58:35.678295 18994 webserver.cc:460] Webserver started at http://127.0.124.131:40837/ using document root <none> and password file <none>
I20260929 22:58:35.678515 18994 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:35.678581 18994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:35.678741 18994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:35.680109 18994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "98b55c4f0dfb495ca6fa145797f671f2"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "0751695e285175f1bceb43caae97abe8"
server_key_iv: "67084bcb1cecfe05939710af6cad440f"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.680483 18994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "98b55c4f0dfb495ca6fa145797f671f2"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "0751695e285175f1bceb43caae97abe8"
server_key_iv: "67084bcb1cecfe05939710af6cad440f"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.681694 18994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:35.682349 19009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.682538 18994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:35.682622 18994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "98b55c4f0dfb495ca6fa145797f671f2"
format_stamp: "Formatted at 2026-09-29 22:58:35 on dist-test-slave-512q"
server_key: "0751695e285175f1bceb43caae97abe8"
server_key_iv: "67084bcb1cecfe05939710af6cad440f"
server_key_version: "encryptionkey@0"
I20260929 22:58:35.682693 18994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:35.694875 18994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:35.696703 18994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:35.696854 18994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:35.697062 18994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:35.697381 18994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:35.697433 18994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.697471 18994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:35.697499 18994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:35.703261 18994 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:36763
I20260929 22:58:35.703306 19122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:36763 every 8 connection(s)
I20260929 22:58:35.703605 18994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:58:35 dist-test-slave-512q krb5kdc[18619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:35.711530 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 18994
I20260929 22:58:35.711644 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:35.711899 498 external_mini_cluster.cc:1428] Setting key 2d7b4374027b5fdb96c169e084bd81c2
I20260929 22:58:35.712736 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.704271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:37699 (local address 127.0.124.190:36957)
0929 22:58:35.704315 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.704318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.704550 (+ 232us) server_negotiation.cc:407] Connection header received
0929 22:58:35.705421 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.705423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.705433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.705490 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:35.706068 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.706551 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.707493 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.707670 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.707721 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.709720 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:35.709721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:35.709722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:35.709728 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:35.711117 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.711650 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.711652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.711652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.711745 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.712045 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.712046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.712047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.712171 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:35.712294 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.712571 (+ 277us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.712651 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:58:35.712949 19125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.704253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:36957 (local address 127.0.124.131:37699)
0929 22:58:35.704405 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.704445 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.705332 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.705563 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.705566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.705802 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:35.705981 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.705985 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.706625 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.706626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.707404 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.707406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.707738 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.707739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.707829 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.708300 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:35.708314 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:35.709604 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:35.711229 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.711236 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.711238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.711551 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.711849 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:35.711850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:35.711851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:35.711957 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:35.712287 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:35.712292 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:35.712444 (+ 152us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.712530 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.712706 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260929 22:58:35.713406 19123 heartbeater.cc:347] Connected to a master server at 127.0.124.190:36957
I20260929 22:58:35.713482 19123 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:35.713708 19123 heartbeater.cc:511] Master 127.0.124.190:36957 requested a full tablet report, sending...
I20260929 22:58:35.714062 18664 ts_manager.cc:194] Registered new tserver with Master: 98b55c4f0dfb495ca6fa145797f671f2 (127.0.124.131:36763)
I20260929 22:58:35.714381 18664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:37699
I20260929 22:58:35.723798 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:35.731535 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.725190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.0.124.190:36957)
0929 22:58:35.725231 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.725233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.725349 (+ 116us) server_negotiation.cc:407] Connection header received
0929 22:58:35.725436 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.725437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.725446 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.725500 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:35.726098 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.726697 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.727449 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.727652 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.727724 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.729087 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:35.729088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:35.729088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:35.729095 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:35.730312 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.730714 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.730715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.730715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.730774 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:35.730994 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:35.730995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:35.730995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:35.731130 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:35.731250 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.731375 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.731439 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:58:35.732990 18664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:35.734509 18664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:35.741062 19136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.0.124.131:36763)
0929 22:58:35.737533 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.737536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.737543 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:58:35.737571 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.737572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.737583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.737642 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:35.737811 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.738941 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.739924 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.740641 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.740716 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.740774 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.740930 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.740981 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":70,"threads_started":1}
I20260929 22:58:35.741055 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:36763 (local address 127.0.0.1:51836)
0929 22:58:35.737060 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.737068 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.737100 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.737671 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.737672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.737674 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:35.737722 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.737723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.739036 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.739036 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.739827 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.739830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.740731 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.740732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.740807 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.740823 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.740902 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.740956 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":61,"threads_started":1}
I20260929 22:58:35.741164 19133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:35467 (local address 127.0.0.1:43152)
0929 22:58:35.736856 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.736897 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.736962 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.737193 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.737196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.737198 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:35.737297 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.737298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.738351 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.738352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.739743 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.739746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.740818 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.740820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.740895 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.740900 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.740955 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.740994 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":58,"threads_started":1}
I20260929 22:58:35.741245 19134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43152 (local address 127.0.124.129:35467)
0929 22:58:35.737023 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.737028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.737046 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:58:35.737078 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.737079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.737092 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.737168 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:35.737376 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.738255 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.739835 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.740641 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.740715 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.740775 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.741097 (+ 322us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.741149 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260929 22:58:35.741340 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:42013 (local address 127.0.0.1:49400)
0929 22:58:35.736963 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.736973 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.737022 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.737709 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.737710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.737711 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:35.737744 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.737745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.739009 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.739010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.740116 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.740118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.741116 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.741117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.741178 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.741182 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.741237 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.741277 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":2,"thread_start_us":58,"threads_started":1}
I20260929 22:58:35.741595 19135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.736805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49400 (local address 127.0.124.130:42013)
0929 22:58:35.737249 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.737254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.737264 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:35.737300 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.737302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.737317 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.737388 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:35.737845 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.738897 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.740197 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.740967 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.741030 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.741082 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.741465 (+ 383us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.741519 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":89,"threads_started":1}
I20260929 22:58:35.741884 18789 tablet_service.cc:1467] Processing CreateTablet for tablet 32f4755f55f6410eaac07a759d92cd68 (DEFAULT_TABLE table=test-table [id=1132f99c8a654ac8bb61ac9625b10606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:35.742230 18789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f4755f55f6410eaac07a759d92cd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:35.742383 19057 tablet_service.cc:1467] Processing CreateTablet for tablet 32f4755f55f6410eaac07a759d92cd68 (DEFAULT_TABLE table=test-table [id=1132f99c8a654ac8bb61ac9625b10606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:35.742722 19057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f4755f55f6410eaac07a759d92cd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:35.744830 18923 tablet_service.cc:1467] Processing CreateTablet for tablet 32f4755f55f6410eaac07a759d92cd68 (DEFAULT_TABLE table=test-table [id=1132f99c8a654ac8bb61ac9625b10606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:35.744942 19137 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Bootstrap starting.
I20260929 22:58:35.745138 18923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32f4755f55f6410eaac07a759d92cd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:35.745549 19137 tablet_bootstrap.cc:654] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:35.745956 19137 log.cc:824] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:35.746615 19137 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: No bootstrap required, opened a new log
I20260929 22:58:35.746670 19137 ts_tablet_manager.cc:1397] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:35.747635 19140 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Bootstrap starting.
I20260929 22:58:35.747936 19138 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Bootstrap starting.
I20260929 22:58:35.748137 19137 raft_consensus.cc:348] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.748391 19137 raft_consensus.cc:374] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:35.748452 19137 raft_consensus.cc:729] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c38d7fe4b14502b1ba39caecddc63f, State: Initialized, Role: FOLLOWER
I20260929 22:58:35.748482 19140 tablet_bootstrap.cc:654] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:35.748584 19138 tablet_bootstrap.cc:654] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:35.748585 19137 consensus_queue.cc:260] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.748884 19137 ts_tablet_manager.cc:1428] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:35.748888 18855 heartbeater.cc:503] Master 127.0.124.190:36957 was elected leader, sending a full tablet report...
I20260929 22:58:35.749135 19140 log.cc:824] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:35.749210 19138 log.cc:824] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:35.749980 19140 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: No bootstrap required, opened a new log
I20260929 22:58:35.750053 19140 ts_tablet_manager.cc:1397] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:35.751351 19140 raft_consensus.cc:348] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.751475 19140 raft_consensus.cc:374] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:35.751497 19140 raft_consensus.cc:729] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7aa440c318473a90a1181a1f25c15e, State: Initialized, Role: FOLLOWER
I20260929 22:58:35.751644 19140 consensus_queue.cc:260] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.751916 19140 ts_tablet_manager.cc:1428] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:35.751928 18989 heartbeater.cc:503] Master 127.0.124.190:36957 was elected leader, sending a full tablet report...
I20260929 22:58:35.752431 19138 tablet_bootstrap.cc:492] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: No bootstrap required, opened a new log
I20260929 22:58:35.752513 19138 ts_tablet_manager.cc:1397] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260929 22:58:35.753909 19138 raft_consensus.cc:348] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.754040 19138 raft_consensus.cc:374] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:35.754061 19138 raft_consensus.cc:729] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b55c4f0dfb495ca6fa145797f671f2, State: Initialized, Role: FOLLOWER
I20260929 22:58:35.754132 19138 consensus_queue.cc:260] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.754362 19138 ts_tablet_manager.cc:1428] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:58:35.754365 19123 heartbeater.cc:503] Master 127.0.124.190:36957 was elected leader, sending a full tablet report...
W20260929 22:58:35.806034 18990 tablet.cc:2369] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:35.881337 19144 raft_consensus.cc:482] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:35.881450 19144 raft_consensus.cc:504] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.881894 19144 leader_election.cc:288] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c38d7fe4b14502b1ba39caecddc63f (127.0.124.129:35467), 98b55c4f0dfb495ca6fa145797f671f2 (127.0.124.131:36763)
I20260929 22:58:35.885752 19136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.882139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:50175 (local address 127.0.124.131:36763)
0929 22:58:35.882177 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.882179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.882189 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:35.882223 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.882224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.882231 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.882306 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:35.882483 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.883206 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.884784 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.885380 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.885451 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.885460 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.885639 (+ 179us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.885685 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:58:35.885725 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.882046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:36763 (local address 127.0.124.130:50175)
0929 22:58:35.882105 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.882116 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.882167 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.882319 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.882320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.882321 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:35.882413 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.882415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.883291 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.883292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.884711 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.884714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.885459 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.885460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.885551 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.885555 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.885599 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.885634 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":78}
I20260929 22:58:35.885844 19134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.882103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:50893 (local address 127.0.124.129:35467)
0929 22:58:35.882157 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.882160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.882300 (+ 140us) server_negotiation.cc:407] Connection header received
0929 22:58:35.882328 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.882329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.882338 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.882389 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:35.882529 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.883216 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.884790 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.885374 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.885460 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.885469 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.885721 (+ 252us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.885773 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:58:35.885891 19146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.882046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:35467 (local address 127.0.124.130:50893)
0929 22:58:35.882219 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.882227 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:35.882270 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:35.882412 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:35.882413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:35.882414 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:35.882470 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.882471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.883291 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.883292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.884711 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:35.884714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.885504 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.885506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:35.885637 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.885642 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:58:35.885697 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:58:35.885738 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":99,"thread_start_us":99,"threads_started":1}
I20260929 22:58:35.886211 18809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32f4755f55f6410eaac07a759d92cd68" candidate_uuid: "bb7aa440c318473a90a1181a1f25c15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c38d7fe4b14502b1ba39caecddc63f" is_pre_election: true
I20260929 22:58:35.886369 18809 raft_consensus.cc:2454] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb7aa440c318473a90a1181a1f25c15e in term 0.
I20260929 22:58:35.886605 18879 leader_election.cc:302] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c38d7fe4b14502b1ba39caecddc63f, bb7aa440c318473a90a1181a1f25c15e; no voters:
I20260929 22:58:35.886636 19077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32f4755f55f6410eaac07a759d92cd68" candidate_uuid: "bb7aa440c318473a90a1181a1f25c15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b55c4f0dfb495ca6fa145797f671f2" is_pre_election: true
I20260929 22:58:35.886730 19144 raft_consensus.cc:2781] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:35.886776 19144 raft_consensus.cc:482] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:35.886782 19077 raft_consensus.cc:2454] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb7aa440c318473a90a1181a1f25c15e in term 0.
I20260929 22:58:35.886796 19144 raft_consensus.cc:3037] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:35.887513 19144 raft_consensus.cc:504] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.887650 19144 leader_election.cc:288] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [CANDIDATE]: Term 1 election: Requested vote from peers 44c38d7fe4b14502b1ba39caecddc63f (127.0.124.129:35467), 98b55c4f0dfb495ca6fa145797f671f2 (127.0.124.131:36763)
I20260929 22:58:35.887790 18809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32f4755f55f6410eaac07a759d92cd68" candidate_uuid: "bb7aa440c318473a90a1181a1f25c15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c38d7fe4b14502b1ba39caecddc63f"
I20260929 22:58:35.887828 19077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32f4755f55f6410eaac07a759d92cd68" candidate_uuid: "bb7aa440c318473a90a1181a1f25c15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b55c4f0dfb495ca6fa145797f671f2"
I20260929 22:58:35.887883 18809 raft_consensus.cc:3037] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:35.887914 19077 raft_consensus.cc:3037] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:35.888612 18809 raft_consensus.cc:2454] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb7aa440c318473a90a1181a1f25c15e in term 1.
I20260929 22:58:35.888684 19077 raft_consensus.cc:2454] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb7aa440c318473a90a1181a1f25c15e in term 1.
I20260929 22:58:35.888803 18879 leader_election.cc:302] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c38d7fe4b14502b1ba39caecddc63f, bb7aa440c318473a90a1181a1f25c15e; no voters:
I20260929 22:58:35.888937 19144 raft_consensus.cc:2781] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:35.889115 19144 raft_consensus.cc:686] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 1 LEADER]: Becoming Leader. State: Replica: bb7aa440c318473a90a1181a1f25c15e, State: Running, Role: LEADER
I20260929 22:58:35.889307 19144 consensus_queue.cc:237] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } }
I20260929 22:58:35.890085 18664 catalog_manager.cc:5495] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e reported cstate change: term changed from 0 to 1, leader changed from <none> to bb7aa440c318473a90a1181a1f25c15e (127.0.124.130). New cstate: current_term: 1 leader_uuid: "bb7aa440c318473a90a1181a1f25c15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7aa440c318473a90a1181a1f25c15e" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 42013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 } health_report { overall_health: UNKNOWN } } }
W20260929 22:58:35.906579 18856 tablet.cc:2369] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:35.925036 19135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.922392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.0.124.130:42013)
0929 22:58:35.922439 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:35.922441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:35.922452 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:58:35.922541 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:35.922541 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:35.922559 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:35.922650 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:35.922825 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.923295 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.924171 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:35.924422 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:35.924500 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:35.924677 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:35.924762 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:35.924864 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:35.924903 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:58:35.924913 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:58:35.926738 19077 raft_consensus.cc:1261] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 1 FOLLOWER]: Refusing update from remote peer bb7aa440c318473a90a1181a1f25c15e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:35.926755 18809 raft_consensus.cc:1261] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 1 FOLLOWER]: Refusing update from remote peer bb7aa440c318473a90a1181a1f25c15e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:35.927093 19147 consensus_queue.cc:1035] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c38d7fe4b14502b1ba39caecddc63f" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 35467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:35.927228 19144 consensus_queue.cc:1035] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b55c4f0dfb495ca6fa145797f671f2" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:35.929661 19151 mvcc.cc:205] Tried to move back new op lower bound from 7334800244433346560 to 7334800244283183104. Current Snapshot: MvccSnapshot[applied={T|T < 7334800244433346560}]
I20260929 22:58:35.931385 18663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:35.931476 18663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:35.932235 18663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d23b0731a354aa8bc40a3802a8ef808: Sending DeleteTablet for 3 replicas of tablet 32f4755f55f6410eaac07a759d92cd68
I20260929 22:58:35.932529 18923 tablet_service.cc:1514] Processing DeleteTablet for tablet 32f4755f55f6410eaac07a759d92cd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:35 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:49400
I20260929 22:58:35.932585 18789 tablet_service.cc:1514] Processing DeleteTablet for tablet 32f4755f55f6410eaac07a759d92cd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:35 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:43152
I20260929 22:58:35.932740 19057 tablet_service.cc:1514] Processing DeleteTablet for tablet 32f4755f55f6410eaac07a759d92cd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:35 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:51836
I20260929 22:58:35.932780 19160 tablet_replica.cc:330] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f: stopping tablet replica
I20260929 22:58:35.932865 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18726
I20260929 22:58:35.932878 19160 raft_consensus.cc:2229] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:35.932974 19160 raft_consensus.cc:2258] T 32f4755f55f6410eaac07a759d92cd68 P 44c38d7fe4b14502b1ba39caecddc63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:35.932974 19161 tablet_replica.cc:330] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: stopping tablet replica
I20260929 22:58:35.933092 19159 tablet_replica.cc:330] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: stopping tablet replica
I20260929 22:58:35.933100 19161 raft_consensus.cc:2229] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:35.933213 19159 raft_consensus.cc:2229] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:58:35.933226 19161 raft_consensus.cc:2258] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:35.933341 19159 raft_consensus.cc:2258] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:35.933706 19159 ts_tablet_manager.cc:1905] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:35.933706 19161 ts_tablet_manager.cc:1905] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:35.935475 19159 ts_tablet_manager.cc:1918] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:35.935484 19161 ts_tablet_manager.cc:1918] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:35.935570 19159 log.cc:1196] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/32f4755f55f6410eaac07a759d92cd68
I20260929 22:58:35.935688 19161 log.cc:1196] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/32f4755f55f6410eaac07a759d92cd68
I20260929 22:58:35.935849 19159 ts_tablet_manager.cc:1939] T 32f4755f55f6410eaac07a759d92cd68 P bb7aa440c318473a90a1181a1f25c15e: Deleting consensus metadata
I20260929 22:58:35.936051 19161 ts_tablet_manager.cc:1939] T 32f4755f55f6410eaac07a759d92cd68 P 98b55c4f0dfb495ca6fa145797f671f2: Deleting consensus metadata
I20260929 22:58:35.936244 18648 catalog_manager.cc:4841] TS bb7aa440c318473a90a1181a1f25c15e (127.0.124.130:42013): tablet 32f4755f55f6410eaac07a759d92cd68 (table test-table [id=1132f99c8a654ac8bb61ac9625b10606]) successfully deleted
I20260929 22:58:35.936486 18650 catalog_manager.cc:4841] TS 98b55c4f0dfb495ca6fa145797f671f2 (127.0.124.131:36763): tablet 32f4755f55f6410eaac07a759d92cd68 (table test-table [id=1132f99c8a654ac8bb61ac9625b10606]) successfully deleted
W20260929 22:58:35.939440 18651 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:35467 (error 108)
I20260929 22:58:35.939612 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18860
I20260929 22:58:35.940280 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:35.939772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:35467 (local address 127.0.0.1:43164)
0929 22:58:35.940184 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:35.940240 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:35467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391}
W20260929 22:58:35.940462 18651 catalog_manager.cc:4584] TS 44c38d7fe4b14502b1ba39caecddc63f (127.0.124.129:35467): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 32f4755f55f6410eaac07a759d92cd68: Network error: Client connection negotiation failed: client connection to 127.0.124.129:35467: connect: Connection refused (error 111)
I20260929 22:58:35.944525 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18994
I20260929 22:58:35.949115 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 18632
2026-09-29T22:58:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1987 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-29T22:58:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:35Z Disabled control of system clock
I20260929 22:58:35.976070 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33837
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:38579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:36.055334 19166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:36.055543 19166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:36.055564 19166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:36.056690 19166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:36.056730 19166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:36.056746 19166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:36.056766 19166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:36.056779 19166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:36.058060 19166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33837
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:36.058231 19166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:36.058465 19166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:36.063287 19171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.063261 19172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.063390 19166 server_base.cc:1034] running on GCE node
W20260929 22:58:36.063265 19174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.063730 19166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:36.063952 19166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:36.065107 19166 hybrid_clock.cc:648] HybridClock initialized: now 1790722716065110 us; error 45 us; skew 500 ppm
I20260929 22:58:36.066196 19166 webserver.cc:460] Webserver started at http://127.0.124.190:46847/ using document root <none> and password file <none>
I20260929 22:58:36.066429 19166 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:36.066493 19166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:36.066641 19166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:36.067592 19166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "816abfbeed53299b6a67f35228a41a98"
server_key_iv: "27a4fc891abfcb4611c28421aefddd20"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.067930 19166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "816abfbeed53299b6a67f35228a41a98"
server_key_iv: "27a4fc891abfcb4611c28421aefddd20"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.069264 19166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:36.069900 19180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.070055 19166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:36.070160 19166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "816abfbeed53299b6a67f35228a41a98"
server_key_iv: "27a4fc891abfcb4611c28421aefddd20"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.070259 19166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:36.081996 19166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:36.082284 19166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:36.082424 19166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:36.086110 19166 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:33837
I20260929 22:58:36.086141 19232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:33837 every 8 connection(s)
I20260929 22:58:36.086464 19166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:36.087318 19233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:36.089560 19233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: Bootstrap starting.
I20260929 22:58:36.090037 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19166
I20260929 22:58:36.090135 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:36.090256 19233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:36.090339 498 external_mini_cluster.cc:1428] Setting key ab409594c77903b1404dd978028e30b2
I20260929 22:58:36.090593 19233 log.cc:824] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:36.091539 19233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: No bootstrap required, opened a new log
I20260929 22:58:36.093843 19233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } }
I20260929 22:58:36.093988 19233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:36.094026 19233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295dd0ec7a6848e6b5a9f0ce6d64484a, State: Initialized, Role: FOLLOWER
I20260929 22:58:36.094354 19233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } }
I20260929 22:58:36.094504 19233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:36.094552 19233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:36.094604 19233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:36.095288 19233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } }
I20260929 22:58:36.095422 19233 leader_election.cc:302] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 295dd0ec7a6848e6b5a9f0ce6d64484a; no voters:
I20260929 22:58:36.095602 19233 leader_election.cc:288] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:36.095679 19238 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:36.095849 19238 raft_consensus.cc:686] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [term 1 LEADER]: Becoming Leader. State: Replica: 295dd0ec7a6848e6b5a9f0ce6d64484a, State: Running, Role: LEADER
I20260929 22:58:36.095876 19233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:36.095992 19238 consensus_queue.cc:237] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } }
I20260929 22:58:36.096382 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.090788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34470 (local address 127.0.124.190:33837)
0929 22:58:36.090971 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.090981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.091020 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:58:36.091517 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.091526 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.091599 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.091746 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:36.091965 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.093384 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.094186 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.094803 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.094962 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.095567 (+ 605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:36.095571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:36.095571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:36.095783 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:36.095826 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:36.095840 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:36.095922 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.096066 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.096156 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260929 22:58:36.096414 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } } }
I20260929 22:58:36.096405 19238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 295dd0ec7a6848e6b5a9f0ce6d64484a. Latest consensus state: current_term: 1 leader_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295dd0ec7a6848e6b5a9f0ce6d64484a" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33837 } } }
I20260929 22:58:36.096757 19238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:36.097102 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:36.097270 19247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:36.097738 19247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:36.099218 19247 catalog_manager.cc:1347] Generated new cluster ID: 6563fdd4cc074c989422cf73da1214a6
I20260929 22:58:36.099277 19247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:36.103941 19247 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:36.104512 19247 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:36.111847 19247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: Generated new TSK 0
I20260929 22:58:36.112033 19247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:36.114830 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--builtin_ntp_servers=127.0.124.148:38579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:36.196650 19257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:36.196902 19257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:36.196925 19257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:36.198208 19257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:36.198247 19257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:36.198272 19257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:36.199568 19257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:36.199801 19257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:36.200148 19257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:36.205881 19265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.205876 19262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.205876 19263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.206060 19257 server_base.cc:1034] running on GCE node
I20260929 22:58:36.206336 19257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:36.206565 19257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:36.207723 19257 hybrid_clock.cc:648] HybridClock initialized: now 1790722716207710 us; error 30 us; skew 500 ppm
I20260929 22:58:36.209079 19257 webserver.cc:460] Webserver started at http://127.0.124.129:33027/ using document root <none> and password file <none>
I20260929 22:58:36.209316 19257 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:36.209384 19257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:36.209522 19257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:36.210569 19257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "1f1ed81bdd9f466a803b04454cb2c3c4"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "3072126a673e7080b2ca90035f613267"
server_key_iv: "24a7cd6b94d32060b149a658c7a072a1"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.210929 19257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "1f1ed81bdd9f466a803b04454cb2c3c4"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "3072126a673e7080b2ca90035f613267"
server_key_iv: "24a7cd6b94d32060b149a658c7a072a1"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.212268 19257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:36.213073 19271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.213253 19257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:36.213343 19257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "1f1ed81bdd9f466a803b04454cb2c3c4"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "3072126a673e7080b2ca90035f613267"
server_key_iv: "24a7cd6b94d32060b149a658c7a072a1"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.213425 19257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:36.251534 19257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:36.251813 19257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:36.251916 19257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:36.252108 19257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:36.252478 19257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:36.252521 19257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.252545 19257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:36.252596 19257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.258229 19257 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:38013
I20260929 22:58:36.258296 19384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:38013 every 8 connection(s)
I20260929 22:58:36.258615 19257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:58:36.263393 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19257
I20260929 22:58:36.263491 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:36.263736 498 external_mini_cluster.cc:1428] Setting key 1a5838404d145aaa98e0ba29754b184d
I20260929 22:58:36.264101 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.259357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:54145 (local address 127.0.124.190:33837)
0929 22:58:36.259400 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.259402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.259620 (+ 218us) server_negotiation.cc:407] Connection header received
0929 22:58:36.260176 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.260177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.260189 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.260270 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:36.261007 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.261507 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.262505 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.262737 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.262821 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.263752 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:36.263754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:36.263754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:36.263759 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:36.263776 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:36.263781 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:36.263844 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.263971 (+ 127us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.264014 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:58:36.264343 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.259328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33837 (local address 127.0.124.129:54145)
0929 22:58:36.259505 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.259537 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.260042 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.260338 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.260342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.260351 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:36.260904 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.260909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.261601 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.261603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.262404 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.262406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.262831 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.262832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.262961 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.263605 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:36.263605 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:36.263645 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:36.263669 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:36.263861 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:36.263866 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:36.263871 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.263968 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.264104 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":61,"threads_started":1}
I20260929 22:58:36.264796 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--builtin_ntp_servers=127.0.124.148:38579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:58:36.264998 19385 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33837
I20260929 22:58:36.265086 19385 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:36.265285 19385 heartbeater.cc:511] Master 127.0.124.190:33837 requested a full tablet report, sending...
I20260929 22:58:36.265719 19197 ts_manager.cc:194] Registered new tserver with Master: 1f1ed81bdd9f466a803b04454cb2c3c4 (127.0.124.129:38013)
I20260929 22:58:36.266367 19197 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.129:54145
W20260929 22:58:36.347009 19388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:36.347198 19388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:36.347218 19388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:36.348326 19388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:36.348361 19388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:36.348385 19388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:36.349664 19388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:36.349848 19388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:36.350047 19388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:36.355213 19393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.355280 19396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.355333 19388 server_base.cc:1034] running on GCE node
W20260929 22:58:36.355280 19394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.355702 19388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:36.355937 19388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:36.357095 19388 hybrid_clock.cc:648] HybridClock initialized: now 1790722716357094 us; error 47 us; skew 500 ppm
I20260929 22:58:36.358348 19388 webserver.cc:460] Webserver started at http://127.0.124.130:38105/ using document root <none> and password file <none>
I20260929 22:58:36.358580 19388 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:36.358660 19388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:36.358804 19388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:36.359800 19388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "89f62873fb1546de95dedf9d97299012"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "11c71e4281b130f5a30de79b3d48a84c"
server_key_iv: "8877cd41cde56b2aec996edcba9f2619"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.360143 19388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "89f62873fb1546de95dedf9d97299012"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "11c71e4281b130f5a30de79b3d48a84c"
server_key_iv: "8877cd41cde56b2aec996edcba9f2619"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.361449 19388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:36.362123 19402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.362275 19388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:36.362370 19388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "89f62873fb1546de95dedf9d97299012"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "11c71e4281b130f5a30de79b3d48a84c"
server_key_iv: "8877cd41cde56b2aec996edcba9f2619"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.362448 19388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:36.387053 19388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:36.387360 19388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:36.387513 19388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:36.387745 19388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:36.388087 19388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:36.388139 19388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.388173 19388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:36.388222 19388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.394026 19388 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:41199
I20260929 22:58:36.394074 19515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:41199 every 8 connection(s)
I20260929 22:58:36.394385 19388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:36.399457 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.395061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:40463 (local address 127.0.124.190:33837)
0929 22:58:36.395122 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.395124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.395343 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:58:36.395819 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.395820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.395829 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.395887 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:36.396666 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.397296 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.398287 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.398468 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.398519 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.399235 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:36.399236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:36.399236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:36.399241 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:36.399254 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:36.399257 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:36.399299 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.399381 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.399400 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:58:36.399680 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.395030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33837 (local address 127.0.124.130:40463)
0929 22:58:36.395211 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.395250 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.395740 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.395938 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.395941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.395949 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:36.396570 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.396575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.397369 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.397371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.398212 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.398214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.398539 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.398540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.398644 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.399111 (+ 467us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:36.399111 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:36.399137 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:36.399158 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:36.399310 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:36.399314 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:36.399316 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.399366 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.399440 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260929 22:58:36.399940 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19388
I20260929 22:58:36.400067 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:36.400194 19516 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33837
I20260929 22:58:36.400293 498 external_mini_cluster.cc:1428] Setting key 3bed3468ab9b1adf8927cdb117628266
I20260929 22:58:36.400321 19516 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:36.400497 19516 heartbeater.cc:511] Master 127.0.124.190:33837 requested a full tablet report, sending...
I20260929 22:58:36.400913 19196 ts_manager.cc:194] Registered new tserver with Master: 89f62873fb1546de95dedf9d97299012 (127.0.124.130:41199)
I20260929 22:58:36.401276 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--builtin_ntp_servers=127.0.124.148:38579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:58:36.401436 19196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.130:40463
W20260929 22:58:36.480376 19519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:36.480583 19519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:36.480618 19519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:36.481793 19519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:36.481850 19519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:36.481890 19519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:36.483227 19519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:33837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:36.483474 19519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:36.483752 19519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:36.488737 19525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.488737 19524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:36.488752 19527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:36.488992 19519 server_base.cc:1034] running on GCE node
I20260929 22:58:36.489172 19519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:36.489382 19519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:36.490557 19519 hybrid_clock.cc:648] HybridClock initialized: now 1790722716490535 us; error 29 us; skew 500 ppm
I20260929 22:58:36.491681 19519 webserver.cc:460] Webserver started at http://127.0.124.131:36991/ using document root <none> and password file <none>
I20260929 22:58:36.491925 19519 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:36.491991 19519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:36.492147 19519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:36.493165 19519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "320a05efa1254a769f7ae52a02d6a2d8"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "9249dcade7655b775c74af1a3a9dd02c"
server_key_iv: "9811bb752355749f7e9fedf1f36f4f0f"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.493511 19519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "320a05efa1254a769f7ae52a02d6a2d8"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "9249dcade7655b775c74af1a3a9dd02c"
server_key_iv: "9811bb752355749f7e9fedf1f36f4f0f"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.494745 19519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:36.495483 19533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.495662 19519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:36.495757 19519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "320a05efa1254a769f7ae52a02d6a2d8"
format_stamp: "Formatted at 2026-09-29 22:58:36 on dist-test-slave-512q"
server_key: "9249dcade7655b775c74af1a3a9dd02c"
server_key_iv: "9811bb752355749f7e9fedf1f36f4f0f"
server_key_version: "encryptionkey@0"
I20260929 22:58:36.495842 19519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:36.514520 19519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:36.514820 19519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:36.514966 19519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:36.515193 19519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:36.515515 19519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:36.515568 19519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.515610 19519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:36.515638 19519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:36.521358 19519 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:39465
I20260929 22:58:36.521417 19646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:39465 every 8 connection(s)
I20260929 22:58:36.521772 19519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:58:36.526021 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19519
I20260929 22:58:36.526122 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:36.526338 498 external_mini_cluster.cc:1428] Setting key b863f687cd4f715d765e853010b7fa06
I20260929 22:58:36.526901 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.522550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:59641 (local address 127.0.124.190:33837)
0929 22:58:36.522614 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.522617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.522848 (+ 231us) server_negotiation.cc:407] Connection header received
0929 22:58:36.523304 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.523305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.523314 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.523364 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:36.524008 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.524511 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.525421 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.525595 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.525647 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.526558 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:36.526559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:36.526560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:36.526564 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:36.526581 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:36.526586 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:36.526667 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.526767 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.526812 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:58:36.527107 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.522540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33837 (local address 127.0.124.131:59641)
0929 22:58:36.522734 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.522766 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.523225 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.523420 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.523424 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.523431 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:36.523941 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.523945 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.524586 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.524587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.525349 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.525351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.525667 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.525668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.525772 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.526395 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:36.526396 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:36.526436 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:36.526463 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:36.526661 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:36.526667 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:36.526670 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.526763 (+ 93us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.526865 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260929 22:58:36.527565 19647 heartbeater.cc:347] Connected to a master server at 127.0.124.190:33837
I20260929 22:58:36.527683 19647 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:36.527860 19647 heartbeater.cc:511] Master 127.0.124.190:33837 requested a full tablet report, sending...
I20260929 22:58:36.528241 19196 ts_manager.cc:194] Registered new tserver with Master: 320a05efa1254a769f7ae52a02d6a2d8 (127.0.124.131:39465)
I20260929 22:58:36.528612 19196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.131:59641
I20260929 22:58:36.538355 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:36.542491 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.539752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34486 (local address 127.0.124.190:33837)
0929 22:58:36.539806 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.539808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.539970 (+ 162us) server_negotiation.cc:407] Connection header received
0929 22:58:36.540017 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.540017 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.540025 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.540080 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:36.540276 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.540746 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.541444 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.541615 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.541663 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.542264 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:36.542265 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:36.542265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:36.542269 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:36.542280 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:36.542284 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:36.542354 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.542430 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.542439 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:58:36.544021 19196 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:36.545533 19196 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:36.551756 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38013 (local address 127.0.0.1:37284)
0929 22:58:36.547712 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.547752 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.547817 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.548325 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.548326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.548327 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:36.548355 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.548356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.549539 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.549540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.550435 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.550439 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.551466 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.551467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.551539 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.551550 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.551626 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.551682 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":65,"threads_started":1}
I20260929 22:58:36.551781 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.0.124.129:38013)
0929 22:58:36.547689 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.547694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.547821 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:58:36.548100 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.548103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.548119 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.548201 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:36.548418 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.549459 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.550548 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.551279 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.551350 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.551433 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.551654 (+ 221us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.551699 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260929 22:58:36.552350 19659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:39465 (local address 127.0.0.1:35818)
0929 22:58:36.547739 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.547756 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.547817 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.548158 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.548160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.548162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:36.548246 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.548248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.550401 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.550402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.551143 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.551145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.552105 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.552106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.552149 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.552152 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.552236 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.552276 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":96,"threads_started":1}
I20260929 22:58:36.552364 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.0.124.131:39465)
0929 22:58:36.547953 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.547957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.547966 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:36.548003 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.548005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.548021 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.548090 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:36.549570 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.550332 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.551234 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.551904 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.551973 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.552065 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.552258 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.552292 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":97,"threads_started":1}
I20260929 22:58:36.552627 19319 tablet_service.cc:1467] Processing CreateTablet for tablet e2eabc424dc240669f3335e409a1df5d (DEFAULT_TABLE table=test-table [id=55bd1fda56d64cedb21e58c4f6b59693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:36.553006 19319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2eabc424dc240669f3335e409a1df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:36.553035 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:41199 (local address 127.0.0.1:48526)
0929 22:58:36.547907 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.547916 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.547964 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.548156 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.548159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.548161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:36.548246 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.548248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.550531 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.550533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.551582 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.551584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.552791 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.552792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.552852 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.552856 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.552914 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.552961 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":2,"thread_start_us":51,"threads_started":1}
I20260929 22:58:36.553071 19660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.547776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48526 (local address 127.0.124.130:41199)
0929 22:58:36.547907 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.547912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.547954 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:58:36.548035 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.548037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.548069 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.548156 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:36.548328 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.549459 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.551680 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.552576 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.552668 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.552752 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.552945 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.552989 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260929 22:58:36.552989 19581 tablet_service.cc:1467] Processing CreateTablet for tablet e2eabc424dc240669f3335e409a1df5d (DEFAULT_TABLE table=test-table [id=55bd1fda56d64cedb21e58c4f6b59693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:36.553295 19581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2eabc424dc240669f3335e409a1df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:36.555411 19661 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Bootstrap starting.
I20260929 22:58:36.556037 19450 tablet_service.cc:1467] Processing CreateTablet for tablet e2eabc424dc240669f3335e409a1df5d (DEFAULT_TABLE table=test-table [id=55bd1fda56d64cedb21e58c4f6b59693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:36.556305 19661 tablet_bootstrap.cc:654] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:36.556348 19450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2eabc424dc240669f3335e409a1df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:36.556551 19662 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Bootstrap starting.
I20260929 22:58:36.556656 19661 log.cc:824] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:36.557189 19662 tablet_bootstrap.cc:654] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:36.557480 19661 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: No bootstrap required, opened a new log
I20260929 22:58:36.557490 19662 log.cc:824] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:36.557551 19661 ts_tablet_manager.cc:1397] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:36.559249 19665 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Bootstrap starting.
I20260929 22:58:36.559568 19661 raft_consensus.cc:348] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.559717 19661 raft_consensus.cc:374] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:36.559762 19661 raft_consensus.cc:729] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1ed81bdd9f466a803b04454cb2c3c4, State: Initialized, Role: FOLLOWER
I20260929 22:58:36.559823 19665 tablet_bootstrap.cc:654] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:36.559890 19661 consensus_queue.cc:260] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.560141 19665 log.cc:824] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:36.560149 19385 heartbeater.cc:503] Master 127.0.124.190:33837 was elected leader, sending a full tablet report...
I20260929 22:58:36.560398 19661 ts_tablet_manager.cc:1428] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:58:36.560863 19665 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: No bootstrap required, opened a new log
I20260929 22:58:36.560931 19665 ts_tablet_manager.cc:1397] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:36.561108 19662 tablet_bootstrap.cc:492] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: No bootstrap required, opened a new log
I20260929 22:58:36.561193 19662 ts_tablet_manager.cc:1397] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260929 22:58:36.562716 19665 raft_consensus.cc:348] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.562830 19665 raft_consensus.cc:374] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:36.562851 19665 raft_consensus.cc:729] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89f62873fb1546de95dedf9d97299012, State: Initialized, Role: FOLLOWER
I20260929 22:58:36.562960 19665 consensus_queue.cc:260] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.563027 19662 raft_consensus.cc:348] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.563217 19662 raft_consensus.cc:374] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:36.563225 19665 ts_tablet_manager.cc:1428] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:58:36.563264 19662 raft_consensus.cc:729] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 320a05efa1254a769f7ae52a02d6a2d8, State: Initialized, Role: FOLLOWER
I20260929 22:58:36.563400 19516 heartbeater.cc:503] Master 127.0.124.190:33837 was elected leader, sending a full tablet report...
I20260929 22:58:36.563376 19662 consensus_queue.cc:260] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.563619 19662 ts_tablet_manager.cc:1428] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:58:36.563658 19647 heartbeater.cc:503] Master 127.0.124.190:33837 was elected leader, sending a full tablet report...
W20260929 22:58:36.644920 19517 tablet.cc:2369] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:36.759316 19386 tablet.cc:2369] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:36.772459 19648 tablet.cc:2369] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:36.835744 19666 raft_consensus.cc:482] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:36.835870 19666 raft_consensus.cc:504] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.836206 19666 leader_election.cc:288] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 320a05efa1254a769f7ae52a02d6a2d8 (127.0.124.131:39465), 89f62873fb1546de95dedf9d97299012 (127.0.124.130:41199)
I20260929 22:58:36.840160 19660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.836464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:32843 (local address 127.0.124.130:41199)
0929 22:58:36.836513 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.836516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.836608 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:58:36.836666 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.836667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.836680 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.836742 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:36.836930 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.837657 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839250 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.839819 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839883 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.839890 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.840047 (+ 157us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.840091 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:58:36.840167 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.836477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:38715 (local address 127.0.124.131:39465)
0929 22:58:36.836520 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.836522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.836609 (+ 87us) server_negotiation.cc:407] Connection header received
0929 22:58:36.836685 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.836686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.836694 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.836743 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:36.836930 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.837645 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839233 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.839793 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839872 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.839882 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.840047 (+ 165us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.840091 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:58:36.840188 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.836393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:39465 (local address 127.0.124.129:38715)
0929 22:58:36.836529 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.836541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.836605 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.836765 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.836766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.836768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:36.836850 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.836853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.837727 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.837728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.839132 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.839136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.839884 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.839958 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.839963 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.840035 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.840078 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":56,"thread_start_us":62,"threads_started":1}
I20260929 22:58:36.840188 19670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.836391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:41199 (local address 127.0.124.129:32843)
0929 22:58:36.836530 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.836541 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:36.836605 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:36.836765 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:36.836766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:36.836769 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:36.836850 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.836852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.837727 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.837728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.839133 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:36.839136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.839891 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.839892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:36.839963 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.839964 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:58:36.840025 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:58:36.840078 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":87,"thread_start_us":60,"threads_started":1}
I20260929 22:58:36.840600 19470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2eabc424dc240669f3335e409a1df5d" candidate_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89f62873fb1546de95dedf9d97299012" is_pre_election: true
I20260929 22:58:36.840602 19601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2eabc424dc240669f3335e409a1df5d" candidate_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "320a05efa1254a769f7ae52a02d6a2d8" is_pre_election: true
I20260929 22:58:36.840754 19601 raft_consensus.cc:2454] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1ed81bdd9f466a803b04454cb2c3c4 in term 0.
I20260929 22:58:36.840754 19470 raft_consensus.cc:2454] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1ed81bdd9f466a803b04454cb2c3c4 in term 0.
I20260929 22:58:36.840997 19272 leader_election.cc:302] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1ed81bdd9f466a803b04454cb2c3c4, 89f62873fb1546de95dedf9d97299012; no voters:
I20260929 22:58:36.841127 19666 raft_consensus.cc:2781] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:36.841216 19666 raft_consensus.cc:482] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:36.841250 19666 raft_consensus.cc:3037] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:36.841961 19666 raft_consensus.cc:504] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.842108 19666 leader_election.cc:288] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [CANDIDATE]: Term 1 election: Requested vote from peers 320a05efa1254a769f7ae52a02d6a2d8 (127.0.124.131:39465), 89f62873fb1546de95dedf9d97299012 (127.0.124.130:41199)
I20260929 22:58:36.842235 19601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2eabc424dc240669f3335e409a1df5d" candidate_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "320a05efa1254a769f7ae52a02d6a2d8"
I20260929 22:58:36.842262 19470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2eabc424dc240669f3335e409a1df5d" candidate_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89f62873fb1546de95dedf9d97299012"
I20260929 22:58:36.842311 19601 raft_consensus.cc:3037] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:36.842367 19470 raft_consensus.cc:3037] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:36.842974 19601 raft_consensus.cc:2454] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1ed81bdd9f466a803b04454cb2c3c4 in term 1.
I20260929 22:58:36.843076 19470 raft_consensus.cc:2454] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1ed81bdd9f466a803b04454cb2c3c4 in term 1.
I20260929 22:58:36.843181 19274 leader_election.cc:302] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1ed81bdd9f466a803b04454cb2c3c4, 320a05efa1254a769f7ae52a02d6a2d8; no voters:
I20260929 22:58:36.843269 19666 raft_consensus.cc:2781] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:36.843401 19666 raft_consensus.cc:686] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [term 1 LEADER]: Becoming Leader. State: Replica: 1f1ed81bdd9f466a803b04454cb2c3c4, State: Running, Role: LEADER
I20260929 22:58:36.843526 19666 consensus_queue.cc:237] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } }
I20260929 22:58:36.844349 19196 catalog_manager.cc:5495] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f1ed81bdd9f466a803b04454cb2c3c4 (127.0.124.129). New cstate: current_term: 1 leader_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1ed81bdd9f466a803b04454cb2c3c4" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 } health_report { overall_health: UNKNOWN } } }
I20260929 22:58:36.903759 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.901394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37292 (local address 127.0.124.129:38013)
0929 22:58:36.901433 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:36.901435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:36.901444 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:36.901523 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:36.901524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:36.901554 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:36.901629 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:36.901779 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.902246 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.903005 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:36.903207 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:36.903283 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:36.903425 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:36.903523 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:36.903639 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:36.903669 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 22:58:36.903679 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:58:36.905555 19601 raft_consensus.cc:1261] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 1 FOLLOWER]: Refusing update from remote peer 1f1ed81bdd9f466a803b04454cb2c3c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:36.905934 19470 raft_consensus.cc:1261] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 1 FOLLOWER]: Refusing update from remote peer 1f1ed81bdd9f466a803b04454cb2c3c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:36.905946 19672 consensus_queue.cc:1035] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "320a05efa1254a769f7ae52a02d6a2d8" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 39465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:36.906267 19672 consensus_queue.cc:1035] T e2eabc424dc240669f3335e409a1df5d P 1f1ed81bdd9f466a803b04454cb2c3c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89f62873fb1546de95dedf9d97299012" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 41199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:36.908507 19677 mvcc.cc:205] Tried to move back new op lower bound from 7334800248442523648 to 7334800248191823872. Current Snapshot: MvccSnapshot[applied={T|T < 7334800248442523648}]
I20260929 22:58:36.908973 19676 mvcc.cc:205] Tried to move back new op lower bound from 7334800248442523648 to 7334800248191823872. Current Snapshot: MvccSnapshot[applied={T|T < 7334800248442523648}]
I20260929 22:58:36.910785 19197 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:36.910876 19197 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:36.911576 19197 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 295dd0ec7a6848e6b5a9f0ce6d64484a: Sending DeleteTablet for 3 replicas of tablet e2eabc424dc240669f3335e409a1df5d
I20260929 22:58:36.911917 19581 tablet_service.cc:1514] Processing DeleteTablet for tablet e2eabc424dc240669f3335e409a1df5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:36 UTC) from {username='slave'} at 127.0.0.1:35818
I20260929 22:58:36.912101 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19257
I20260929 22:58:36.912124 19450 tablet_service.cc:1514] Processing DeleteTablet for tablet e2eabc424dc240669f3335e409a1df5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:36 UTC) from {username='slave'} at 127.0.0.1:48526
I20260929 22:58:36.913655 19686 tablet_replica.cc:330] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: stopping tablet replica
I20260929 22:58:36.913764 19686 raft_consensus.cc:2229] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:36.913868 19686 raft_consensus.cc:2258] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:36.914029 19685 tablet_replica.cc:330] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: stopping tablet replica
I20260929 22:58:36.914119 19685 raft_consensus.cc:2229] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:36.914211 19685 raft_consensus.cc:2258] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:36.914327 19686 ts_tablet_manager.cc:1905] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:36.914602 19685 ts_tablet_manager.cc:1905] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:36.915980 19686 ts_tablet_manager.cc:1918] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:36.916070 19686 log.cc:1196] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/e2eabc424dc240669f3335e409a1df5d
I20260929 22:58:36.916356 19686 ts_tablet_manager.cc:1939] T e2eabc424dc240669f3335e409a1df5d P 89f62873fb1546de95dedf9d97299012: Deleting consensus metadata
I20260929 22:58:36.916505 19685 ts_tablet_manager.cc:1918] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:36.916577 19685 log.cc:1196] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/e2eabc424dc240669f3335e409a1df5d
I20260929 22:58:36.916833 19685 ts_tablet_manager.cc:1939] T e2eabc424dc240669f3335e409a1df5d P 320a05efa1254a769f7ae52a02d6a2d8: Deleting consensus metadata
I20260929 22:58:36.916823 19181 catalog_manager.cc:4841] TS 89f62873fb1546de95dedf9d97299012 (127.0.124.130:41199): tablet e2eabc424dc240669f3335e409a1df5d (table test-table [id=55bd1fda56d64cedb21e58c4f6b59693]) successfully deleted
I20260929 22:58:36.917207 19183 catalog_manager.cc:4841] TS 320a05efa1254a769f7ae52a02d6a2d8 (127.0.124.131:39465): tablet e2eabc424dc240669f3335e409a1df5d (table test-table [id=55bd1fda56d64cedb21e58c4f6b59693]) successfully deleted
W20260929 22:58:36.918200 19181 connection.cc:535] client connection to 127.0.124.129:38013 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 22:58:36.918288 19181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:58:36.918694 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:36.918567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38013 (local address 127.0.0.1:37298)
0929 22:58:36.918616 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:36.918652 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:58:36.918752 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19388
W20260929 22:58:36.918830 19181 catalog_manager.cc:4584] TS 1f1ed81bdd9f466a803b04454cb2c3c4 (127.0.124.129:38013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2eabc424dc240669f3335e409a1df5d: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38013: connect: Connection refused (error 111)
I20260929 22:58:36.923641 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19519
I20260929 22:58:36.928089 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19166
2026-09-29T22:58:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (978 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:36 dist-test-slave-512q krb5kdc[19690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:36 dist-test-slave-512q krb5kdc[19690](info): set up 2 sockets
Sep 29 22:58:36 dist-test-slave-512q krb5kdc[19690](info): commencing operation
krb5kdc: starting...
W20260929 22:58:37.990293 498 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:38.102780 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40273
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40273
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:38.181303 19703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:38.181486 19703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:38.181507 19703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:38.182574 19703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:38.182608 19703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:38.182622 19703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:38.182641 19703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:38.182653 19703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:38.184033 19703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:38.184252 19703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:38.184444 19703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:38.189118 19708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.189143 19709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:38.189283 19703 server_base.cc:1034] running on GCE node
W20260929 22:58:38.189126 19711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:38.189657 19703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:38.189962 19703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:38.191100 19703 hybrid_clock.cc:648] HybridClock initialized: now 1790722718191075 us; error 39 us; skew 500 ppm
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:38.193599 19703 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:38.193964 19703 webserver.cc:460] Webserver started at http://127.0.124.190:33023/ using document root <none> and password file <none>
I20260929 22:58:38.194157 19703 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:38.194198 19703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:38.194322 19703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:38.195287 19703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "ed0838c94baa4f859ad5a154627f7862"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "f818ec0f772912266e4628fe58800e80"
server_key_iv: "2f9a24b2e681cae3e90625f9b03bf427"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.195571 19703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "ed0838c94baa4f859ad5a154627f7862"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "f818ec0f772912266e4628fe58800e80"
server_key_iv: "2f9a24b2e681cae3e90625f9b03bf427"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.196869 19703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 22:58:38.197548 19718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.197717 19703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:38.197820 19703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "ed0838c94baa4f859ad5a154627f7862"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "f818ec0f772912266e4628fe58800e80"
server_key_iv: "2f9a24b2e681cae3e90625f9b03bf427"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.197892 19703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:38.215994 19703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:38.217947 19703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:38.218124 19703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:38.222303 19703 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:40273
I20260929 22:58:38.222348 19770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:40273 every 8 connection(s)
I20260929 22:58:38.222707 19703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:38.223553 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:38.225857 19771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: Bootstrap starting.
I20260929 22:58:38.226374 19771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:38.226596 19771 log.cc:824] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:38.227294 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19703
I20260929 22:58:38.227356 19771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: No bootstrap required, opened a new log
I20260929 22:58:38.227408 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:38.227612 498 external_mini_cluster.cc:1428] Setting key d232c6255d03380c446c02d472aa24aa
I20260929 22:58:38.229305 19771 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } }
I20260929 22:58:38.229467 19771 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:38.229503 19771 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0838c94baa4f859ad5a154627f7862, State: Initialized, Role: FOLLOWER
I20260929 22:58:38.229687 19771 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } }
I20260929 22:58:38.229781 19771 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:38.229817 19771 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:38.229868 19771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:38.230839 19771 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } }
I20260929 22:58:38.230962 19771 leader_election.cc:302] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed0838c94baa4f859ad5a154627f7862; no voters:
I20260929 22:58:38.231139 19771 leader_election.cc:288] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:38.231176 19777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:38.231341 19777 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [term 1 LEADER]: Becoming Leader. State: Replica: ed0838c94baa4f859ad5a154627f7862, State: Running, Role: LEADER
I20260929 22:58:38.231386 19771 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:38.231459 19777 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } }
I20260929 22:58:38.231884 19778 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed0838c94baa4f859ad5a154627f7862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } } }
I20260929 22:58:38.231957 19778 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:38.231910 19779 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed0838c94baa4f859ad5a154627f7862. Latest consensus state: current_term: 1 leader_uuid: "ed0838c94baa4f859ad5a154627f7862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed0838c94baa4f859ad5a154627f7862" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40273 } } }
I20260929 22:58:38.232008 19779 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:38.232393 19786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:38.232900 19786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:38.234845 19786 catalog_manager.cc:1347] Generated new cluster ID: 6f5a4ad1aada42ca9edd498188758bfa
I20260929 22:58:38.234899 19786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:38.239653 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.228126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46176 (local address 127.0.124.190:40273)
0929 22:58:38.228304 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.228332 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.228356 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:58:38.229289 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.229294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.229337 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.229446 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:38.230260 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.231323 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.232455 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.233027 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.233614 (+ 587us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.235913 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:38.235917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:38.235917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:38.235928 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:38.237871 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.238235 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.238238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.238238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.238354 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.238557 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.238557 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.238558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.238820 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:38.238944 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.239333 (+ 389us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.239460 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":104,"threads_started":1}
I20260929 22:58:38.241107 19786 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:38.241600 19786 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:38.245584 19786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: Generated new TSK 0
I20260929 22:58:38.245748 19786 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.124.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
Entry for principal kudu/127.0.124.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab.
I20260929 22:58:38.270900 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:38.351681 19798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:38.351872 19798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:38.351894 19798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:38.353101 19798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:38.353143 19798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:38.353170 19798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:38.354686 19798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.129.keytab
--principal=kudu/127.0.124.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:38.354938 19798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:38.355147 19798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:38.360100 19804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.360119 19806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.360257 19803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:38.360371 19798 server_base.cc:1034] running on GCE node
I20260929 22:58:38.360615 19798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:38.360844 19798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:38.362006 19798 hybrid_clock.cc:648] HybridClock initialized: now 1790722718361984 us; error 39 us; skew 500 ppm
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:38.364439 19798 init.cc:377] Logged in from keytab as kudu/127.0.124.129@KRBTEST.COM (short username kudu)
I20260929 22:58:38.364979 19798 webserver.cc:460] Webserver started at http://127.0.124.129:45501/ using document root <none> and password file <none>
I20260929 22:58:38.365152 19798 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:38.365191 19798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:38.365273 19798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:38.366207 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "86d475c7c87e4888829ee8e9fad3edea"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "9fa8f8a3744138440c686fdc22988c50"
server_key_iv: "c75d8a771f6ae218e36f5908f059c9ba"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.366487 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "86d475c7c87e4888829ee8e9fad3edea"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "9fa8f8a3744138440c686fdc22988c50"
server_key_iv: "c75d8a771f6ae218e36f5908f059c9ba"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.367652 19798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:38.368306 19813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.368455 19798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.368538 19798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "86d475c7c87e4888829ee8e9fad3edea"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "9fa8f8a3744138440c686fdc22988c50"
server_key_iv: "c75d8a771f6ae218e36f5908f059c9ba"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.368589 19798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:38.379666 19798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:38.381397 19798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:38.381501 19798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:38.381668 19798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:38.381896 19798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:38.381924 19798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.381945 19798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:38.381970 19798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.387867 19798 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:40139
I20260929 22:58:38.387974 19926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:40139 every 8 connection(s)
I20260929 22:58:38.388324 19798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.129@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:38.395334 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19798
I20260929 22:58:38.395478 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:38.395681 498 external_mini_cluster.cc:1428] Setting key b582d2895e6b126e264245f608b2a67a
I20260929 22:58:38.397572 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.389072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:44595 (local address 127.0.124.190:40273)
0929 22:58:38.389154 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.389156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.389329 (+ 173us) server_negotiation.cc:407] Connection header received
0929 22:58:38.390270 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.390271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.390284 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.390338 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:38.390897 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.391389 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.392354 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.392545 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.392598 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.394684 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:38.394686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:38.394686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:38.394695 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:38.396247 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.396647 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.396648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.396648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.396711 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.396944 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.396945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.396945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.397062 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:38.397131 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.397386 (+ 255us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.397476 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:58:38.397794 19929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.389039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40273 (local address 127.0.124.129:44595)
0929 22:58:38.389205 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.389243 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.390180 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.390391 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.390394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.390640 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:38.390829 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.390832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.391467 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.391467 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.392284 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.392286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.392614 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.392615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.392706 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.393252 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:38.393261 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:38.394606 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:38.396357 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.396363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.396365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.396564 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.396776 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.396777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.396778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.396879 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.397133 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:38.397140 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:38.397258 (+ 118us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.397353 (+ 95us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.397497 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260929 22:58:38.398308 19927 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40273
I20260929 22:58:38.398402 19927 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:38.398576 19927 heartbeater.cc:511] Master 127.0.124.190:40273 requested a full tablet report, sending...
I20260929 22:58:38.399133 19735 ts_manager.cc:194] Registered new tserver with Master: 86d475c7c87e4888829ee8e9fad3edea (127.0.124.129:40139)
I20260929 22:58:38.400185 19735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.129@KRBTEST.COM'} at 127.0.124.129:44595
WARNING: no policy specified for kudu/127.0.124.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
Entry for principal kudu/127.0.124.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab.
I20260929 22:58:38.420769 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:38.501135 19932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:38.501360 19932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:38.501396 19932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:38.502523 19932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:38.502584 19932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:38.502625 19932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:38.504094 19932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.130.keytab
--principal=kudu/127.0.124.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:38.504375 19932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:38.504652 19932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:38.509423 19937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.509491 19938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.509488 19940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:38.509673 19932 server_base.cc:1034] running on GCE node
I20260929 22:58:38.509922 19932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:38.510180 19932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:38.511336 19932 hybrid_clock.cc:648] HybridClock initialized: now 1790722718511325 us; error 44 us; skew 500 ppm
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:38.513783 19932 init.cc:377] Logged in from keytab as kudu/127.0.124.130@KRBTEST.COM (short username kudu)
I20260929 22:58:38.514236 19932 webserver.cc:460] Webserver started at http://127.0.124.130:34923/ using document root <none> and password file <none>
I20260929 22:58:38.514458 19932 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:38.514523 19932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:38.514705 19932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:38.515704 19932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "9a188fc5753841c3bd2dddf13ee5069d"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "fc4c71a40c27ccf12e96f33cdfbf0d3e"
server_key_iv: "e575215fc5c0234371aa59a8a843acd4"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.516068 19932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "9a188fc5753841c3bd2dddf13ee5069d"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "fc4c71a40c27ccf12e96f33cdfbf0d3e"
server_key_iv: "e575215fc5c0234371aa59a8a843acd4"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.517383 19932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:38.518102 19947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.518275 19932 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:38.518369 19932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "9a188fc5753841c3bd2dddf13ee5069d"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "fc4c71a40c27ccf12e96f33cdfbf0d3e"
server_key_iv: "e575215fc5c0234371aa59a8a843acd4"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.518447 19932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:38.533732 19932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:38.536077 19932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:38.536279 19932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:38.536515 19932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:38.536813 19932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:38.536867 19932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.536906 19932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:38.536932 19932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.542375 19932 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:45527
I20260929 22:58:38.542420 20060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:45527 every 8 connection(s)
I20260929 22:58:38.542711 19932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:38.545342 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 19932
I20260929 22:58:38.545441 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:38.545617 498 external_mini_cluster.cc:1428] Setting key d6665b8e260de6db04bcd916f5952714
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.130@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:38.552285 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.543400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:35729 (local address 127.0.124.190:40273)
0929 22:58:38.543446 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.543448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.543633 (+ 185us) server_negotiation.cc:407] Connection header received
0929 22:58:38.544528 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.544529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.544538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.544623 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:38.545217 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.545945 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.546975 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.547282 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.547347 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.549514 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:38.549516 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:38.549516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:38.549523 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:38.550917 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.551323 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.551324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.551325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.551383 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.551632 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.551633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.551633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.551743 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:38.551810 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.552089 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.552176 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:58:38.552434 20063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.543368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40273 (local address 127.0.124.130:35729)
0929 22:58:38.543521 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.543562 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.544446 (+ 884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.544696 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.544699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.544926 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:38.545129 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.545143 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.546029 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.546029 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.546874 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.546877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.547356 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.547357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.547487 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.548036 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:38.548043 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:38.549421 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:38.551017 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.551024 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.551026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.551240 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.551447 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.551448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.551448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.551553 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.551814 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:38.551821 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:38.551951 (+ 130us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.552049 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.552194 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260929 22:58:38.553151 20061 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40273
I20260929 22:58:38.553226 20061 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:38.553396 20061 heartbeater.cc:511] Master 127.0.124.190:40273 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.124.131@KRBTEST.COM; defaulting to no policy
I20260929 22:58:38.553757 19735 ts_manager.cc:194] Registered new tserver with Master: 9a188fc5753841c3bd2dddf13ee5069d (127.0.124.130:45527)
I20260929 22:58:38.554133 19735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.130@KRBTEST.COM'} at 127.0.124.130:35729
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
Entry for principal kudu/127.0.124.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab.
I20260929 22:58:38.569054 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:38793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:38.647316 20066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:38.647549 20066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:38.647588 20066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:38.648823 20066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:38.648888 20066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:38.648931 20066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:38.650381 20066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:38793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/krb5kdc/kudu_127.0.124.131.keytab
--principal=kudu/127.0.124.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:40273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:38.650643 20066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:38.650866 20066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:38.655619 20071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.655608 20072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:38.655608 20074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:38.655830 20066 server_base.cc:1034] running on GCE node
I20260929 22:58:38.656107 20066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:38.656364 20066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:38.657500 20066 hybrid_clock.cc:648] HybridClock initialized: now 1790722718657481 us; error 35 us; skew 500 ppm
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:38.659770 20066 init.cc:377] Logged in from keytab as kudu/127.0.124.131@KRBTEST.COM (short username kudu)
I20260929 22:58:38.660111 20066 webserver.cc:460] Webserver started at http://127.0.124.131:42977/ using document root <none> and password file <none>
I20260929 22:58:38.660342 20066 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:38.660386 20066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:38.660470 20066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:38.661396 20066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "46b89ea203fe4473a78c656006c83bbb"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "5fb8939488b19f236c7fad90020a3b2a"
server_key_iv: "43f59e42d2a26f0673c9110ecfce283a"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.661705 20066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "46b89ea203fe4473a78c656006c83bbb"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "5fb8939488b19f236c7fad90020a3b2a"
server_key_iv: "43f59e42d2a26f0673c9110ecfce283a"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.662892 20066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:38.663543 20081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.663692 20066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:38.663772 20066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "46b89ea203fe4473a78c656006c83bbb"
format_stamp: "Formatted at 2026-09-29 22:58:38 on dist-test-slave-512q"
server_key: "5fb8939488b19f236c7fad90020a3b2a"
server_key_iv: "43f59e42d2a26f0673c9110ecfce283a"
server_key_version: "encryptionkey@0"
I20260929 22:58:38.663825 20066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:38.678148 20066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:38.679796 20066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:38.679908 20066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:38.680063 20066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:38.680379 20066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:38.680413 20066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.680434 20066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:38.680446 20066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:38.685802 20066 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:36423
I20260929 22:58:38.685877 20194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:36423 every 8 connection(s)
I20260929 22:58:38.686203 20066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:58:38 dist-test-slave-512q krb5kdc[19690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.131@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:38.693280 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20066
I20260929 22:58:38.693362 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:38.693567 498 external_mini_cluster.cc:1428] Setting key 7592b9bea29bb509465587ba28201100
I20260929 22:58:38.694931 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.686923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:55067 (local address 127.0.124.190:40273)
0929 22:58:38.686990 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.686992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.687190 (+ 198us) server_negotiation.cc:407] Connection header received
0929 22:58:38.688066 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.688067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.688075 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.688126 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:38.688691 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.689187 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.690087 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.690288 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.690338 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.692379 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:38.692380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:38.692380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:38.692386 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:38.693613 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.694072 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.694074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.694074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.694127 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.694463 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.694464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.694464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.694563 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:38.694613 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.694819 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.694872 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:58:38.695086 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.686901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:40273 (local address 127.0.124.131:55067)
0929 22:58:38.687059 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.687097 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.687973 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.688185 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.688188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.688434 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:38.688617 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.688621 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.689260 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.689260 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.690012 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.690014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.690355 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.690356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.690456 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.690969 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:58:38.690976 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:38.692293 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:38.693697 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.693703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.693705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.694003 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.694207 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:58:38.694207 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:58:38.694207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:58:38.694318 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:58:38.694616 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:38.694620 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:38.694722 (+ 102us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.694804 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.694908 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260929 22:58:38.695544 20195 heartbeater.cc:347] Connected to a master server at 127.0.124.190:40273
I20260929 22:58:38.695636 20195 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:38.695806 20195 heartbeater.cc:511] Master 127.0.124.190:40273 requested a full tablet report, sending...
I20260929 22:58:38.696168 19735 ts_manager.cc:194] Registered new tserver with Master: 46b89ea203fe4473a78c656006c83bbb (127.0.124.131:36423)
I20260929 22:58:38.696564 19735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.124.131@KRBTEST.COM'} at 127.0.124.131:55067
I20260929 22:58:38.705240 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:38.712608 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.706575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46192 (local address 127.0.124.190:40273)
0929 22:58:38.706653 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.706655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.706755 (+ 100us) server_negotiation.cc:407] Connection header received
0929 22:58:38.706834 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.706835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.706845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.706919 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:38.707450 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.707910 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.708705 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.708891 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.708958 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.710092 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:38.710094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:38.710094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:38.710101 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:38.711448 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.711789 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.711790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.711791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.711848 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:38.712053 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:38.712054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:38.712055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:38.712204 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:38.712330 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.712443 (+ 113us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.712514 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:58:38.714161 19735 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:38.715631 19735 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:38.722018 20203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.717685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40139 (local address 127.0.0.1:60198)
0929 22:58:38.717792 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.717827 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.717888 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.718342 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.718343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.718345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:38.718702 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.718704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719846 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.719848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.720739 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.720741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.721719 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.721797 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.721810 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.721882 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.721937 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":66,"threads_started":1}
I20260929 22:58:38.722092 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.717957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60198 (local address 127.0.124.129:40139)
0929 22:58:38.718151 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.718156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.718166 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:38.718205 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.718207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.718225 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.718337 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:38.718787 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719753 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.720842 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.721642 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721709 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.721764 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.721938 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.722010 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":80,"threads_started":1}
I20260929 22:58:38.722294 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.718130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55802 (local address 127.0.124.130:45527)
0929 22:58:38.718323 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.718327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.718336 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:38.718369 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.718372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.718387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.718467 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:38.718545 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719366 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721136 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.721661 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721746 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.721800 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.722085 (+ 285us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.722217 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":79,"threads_started":1}
I20260929 22:58:38.722352 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.717721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:36423 (local address 127.0.0.1:34692)
0929 22:58:38.717939 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.717949 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.718003 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.718264 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.718267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.718269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:38.718335 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.718336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719529 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.719530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.720852 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.720855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.722133 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.722133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.722193 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.722197 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.722243 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.722276 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":106,"thread_start_us":52,"threads_started":1}
I20260929 22:58:38.722420 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.717722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:45527 (local address 127.0.0.1:55802)
0929 22:58:38.718077 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.718085 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.718123 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.718464 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.718465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.718467 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:38.718498 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.718500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719461 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.719461 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.721061 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.721063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.721832 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721832 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.721892 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.721894 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.721939 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.721969 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":81,"thread_start_us":72,"threads_started":1}
I20260929 22:58:38.722761 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.717930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34692 (local address 127.0.124.131:36423)
0929 22:58:38.718081 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.718085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.718097 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:58:38.718135 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.718137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.718153 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.718239 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:38.718417 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.719449 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.720932 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.721631 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.721709 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.721764 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.722435 (+ 671us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.722486 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260929 22:58:38.722755 19861 tablet_service.cc:1467] Processing CreateTablet for tablet c481855d00c74a87a83f32ff5ab04138 (DEFAULT_TABLE table=test-table [id=9bc2331859c24ff6a9c13c7896211a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:38.723124 19861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c481855d00c74a87a83f32ff5ab04138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:38.723453 20129 tablet_service.cc:1467] Processing CreateTablet for tablet c481855d00c74a87a83f32ff5ab04138 (DEFAULT_TABLE table=test-table [id=9bc2331859c24ff6a9c13c7896211a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:38.723747 20129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c481855d00c74a87a83f32ff5ab04138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:38.724576 19995 tablet_service.cc:1467] Processing CreateTablet for tablet c481855d00c74a87a83f32ff5ab04138 (DEFAULT_TABLE table=test-table [id=9bc2331859c24ff6a9c13c7896211a41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:38.724857 19995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c481855d00c74a87a83f32ff5ab04138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:38.726595 20209 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: Bootstrap starting.
I20260929 22:58:38.726949 20210 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Bootstrap starting.
I20260929 22:58:38.727384 20209 tablet_bootstrap.cc:654] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:38.727561 20210 tablet_bootstrap.cc:654] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:38.727891 20211 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Bootstrap starting.
I20260929 22:58:38.728010 20209 log.cc:824] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:38.728178 20210 log.cc:824] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:38.728583 20211 tablet_bootstrap.cc:654] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:38.728873 20209 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: No bootstrap required, opened a new log
I20260929 22:58:38.729043 20210 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: No bootstrap required, opened a new log
I20260929 22:58:38.729048 20209 ts_tablet_manager.cc:1397] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260929 22:58:38.729115 20210 ts_tablet_manager.cc:1397] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:38.729094 20211 log.cc:824] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:38.729890 20211 tablet_bootstrap.cc:492] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: No bootstrap required, opened a new log
I20260929 22:58:38.729962 20211 ts_tablet_manager.cc:1397] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:58:38.730717 20209 raft_consensus.cc:348] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.730880 20209 raft_consensus.cc:374] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:38.730942 20209 raft_consensus.cc:729] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d475c7c87e4888829ee8e9fad3edea, State: Initialized, Role: FOLLOWER
I20260929 22:58:38.731132 20209 consensus_queue.cc:260] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.731161 20210 raft_consensus.cc:348] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.731333 20210 raft_consensus.cc:374] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:38.731379 20210 raft_consensus.cc:729] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b89ea203fe4473a78c656006c83bbb, State: Initialized, Role: FOLLOWER
I20260929 22:58:38.731419 20209 ts_tablet_manager.cc:1428] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:58:38.731490 20210 consensus_queue.cc:260] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.731565 19927 heartbeater.cc:503] Master 127.0.124.190:40273 was elected leader, sending a full tablet report...
I20260929 22:58:38.731848 20195 heartbeater.cc:503] Master 127.0.124.190:40273 was elected leader, sending a full tablet report...
I20260929 22:58:38.732015 20211 raft_consensus.cc:348] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.732241 20211 raft_consensus.cc:374] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:38.732338 20211 raft_consensus.cc:729] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a188fc5753841c3bd2dddf13ee5069d, State: Initialized, Role: FOLLOWER
I20260929 22:58:38.731832 20210 ts_tablet_manager.cc:1428] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:58:38.732481 20211 consensus_queue.cc:260] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.732784 20211 ts_tablet_manager.cc:1428] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:58:38.732931 20061 heartbeater.cc:503] Master 127.0.124.190:40273 was elected leader, sending a full tablet report...
W20260929 22:58:38.793252 20062 tablet.cc:2369] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:38.833319 20215 raft_consensus.cc:482] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:38.833487 20215 raft_consensus.cc:504] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.833818 20215 leader_election.cc:288] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a188fc5753841c3bd2dddf13ee5069d (127.0.124.130:45527), 46b89ea203fe4473a78c656006c83bbb (127.0.124.131:36423)
I20260929 22:58:38.837690 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.834113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:59251 (local address 127.0.124.131:36423)
0929 22:58:38.834155 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.834157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.834163 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:58:38.834194 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.834195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.834222 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.834276 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:38.834457 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.835210 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.836756 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.837326 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.837406 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.837414 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.837582 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.837620 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:58:38.837690 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.834008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:44919 (local address 127.0.124.130:45527)
0929 22:58:38.834060 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.834062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.834251 (+ 189us) server_negotiation.cc:407] Connection header received
0929 22:58:38.834277 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.834278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.834287 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.834334 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:38.834456 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.835222 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.836756 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.837326 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.837406 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.837414 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.837582 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.837620 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:58:38.837697 19929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.833963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:36423 (local address 127.0.124.129:59251)
0929 22:58:38.834013 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.834024 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.834066 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.834297 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.834298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.834300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:38.834377 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.834379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.835299 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.835300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.836664 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.836667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.837410 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.837411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.837496 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.837499 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.837557 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.837597 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":82}
I20260929 22:58:38.837704 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.833964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:45527 (local address 127.0.124.129:44919)
0929 22:58:38.834147 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.834157 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:38.834218 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:38.834335 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:38.834335 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:38.834336 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:38.834393 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.834395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.835299 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.835300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.836664 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:38.836667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.837410 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.837411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:38.837496 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.837499 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:38.837557 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:58:38.837597 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":58,"thread_start_us":97,"threads_started":1}
I20260929 22:58:38.838073 20149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c481855d00c74a87a83f32ff5ab04138" candidate_uuid: "86d475c7c87e4888829ee8e9fad3edea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b89ea203fe4473a78c656006c83bbb" is_pre_election: true
I20260929 22:58:38.838065 20015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c481855d00c74a87a83f32ff5ab04138" candidate_uuid: "86d475c7c87e4888829ee8e9fad3edea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a188fc5753841c3bd2dddf13ee5069d" is_pre_election: true
I20260929 22:58:38.838227 20015 raft_consensus.cc:2454] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d475c7c87e4888829ee8e9fad3edea in term 0.
I20260929 22:58:38.838233 20149 raft_consensus.cc:2454] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d475c7c87e4888829ee8e9fad3edea in term 0.
I20260929 22:58:38.838433 19817 leader_election.cc:302] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d475c7c87e4888829ee8e9fad3edea, 9a188fc5753841c3bd2dddf13ee5069d; no voters:
I20260929 22:58:38.838613 20215 raft_consensus.cc:2781] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:38.838697 20215 raft_consensus.cc:482] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:38.838732 20215 raft_consensus.cc:3037] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:38.839382 20215 raft_consensus.cc:504] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.839527 20215 leader_election.cc:288] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [CANDIDATE]: Term 1 election: Requested vote from peers 9a188fc5753841c3bd2dddf13ee5069d (127.0.124.130:45527), 46b89ea203fe4473a78c656006c83bbb (127.0.124.131:36423)
I20260929 22:58:38.839696 20015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c481855d00c74a87a83f32ff5ab04138" candidate_uuid: "86d475c7c87e4888829ee8e9fad3edea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a188fc5753841c3bd2dddf13ee5069d"
I20260929 22:58:38.839725 20149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c481855d00c74a87a83f32ff5ab04138" candidate_uuid: "86d475c7c87e4888829ee8e9fad3edea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b89ea203fe4473a78c656006c83bbb"
I20260929 22:58:38.839776 20015 raft_consensus.cc:3037] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:38.839802 20149 raft_consensus.cc:3037] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:38.840526 20015 raft_consensus.cc:2454] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d475c7c87e4888829ee8e9fad3edea in term 1.
I20260929 22:58:38.840545 20149 raft_consensus.cc:2454] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d475c7c87e4888829ee8e9fad3edea in term 1.
I20260929 22:58:38.840689 19817 leader_election.cc:302] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d475c7c87e4888829ee8e9fad3edea, 9a188fc5753841c3bd2dddf13ee5069d; no voters:
I20260929 22:58:38.840790 20215 raft_consensus.cc:2781] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:38.840943 20215 raft_consensus.cc:686] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 1 LEADER]: Becoming Leader. State: Replica: 86d475c7c87e4888829ee8e9fad3edea, State: Running, Role: LEADER
I20260929 22:58:38.841044 20215 consensus_queue.cc:237] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } }
I20260929 22:58:38.841905 19734 catalog_manager.cc:5495] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea reported cstate change: term changed from 0 to 1, leader changed from <none> to 86d475c7c87e4888829ee8e9fad3edea (127.0.124.129). New cstate: current_term: 1 leader_uuid: "86d475c7c87e4888829ee8e9fad3edea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86d475c7c87e4888829ee8e9fad3edea" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 40139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 } health_report { overall_health: UNKNOWN } } }
I20260929 22:58:38.865597 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.863168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.0.124.129:40139)
0929 22:58:38.863232 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:38.863234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:38.863259 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:58:38.863303 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:38.863304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:38.863320 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:38.863393 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:38.863554 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.864025 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.864824 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:38.865015 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:38.865090 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:38.865260 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:38.865359 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:38.865446 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:38.865467 (+ 21us) server_negotiation.cc:299] Negotiation successful
0929 22:58:38.865487 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:58:38.867439 20149 raft_consensus.cc:1261] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 1 FOLLOWER]: Refusing update from remote peer 86d475c7c87e4888829ee8e9fad3edea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:38.867439 20015 raft_consensus.cc:1261] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 1 FOLLOWER]: Refusing update from remote peer 86d475c7c87e4888829ee8e9fad3edea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:38.867801 20219 consensus_queue.cc:1035] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a188fc5753841c3bd2dddf13ee5069d" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 45527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:38.867938 20215 consensus_queue.cc:1035] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b89ea203fe4473a78c656006c83bbb" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 36423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:38.869947 20222 mvcc.cc:205] Tried to move back new op lower bound from 7334800256477995008 to 7334800256373587968. Current Snapshot: MvccSnapshot[applied={T|T < 7334800256477995008}]
I20260929 22:58:38.870543 20224 mvcc.cc:205] Tried to move back new op lower bound from 7334800256477995008 to 7334800256373587968. Current Snapshot: MvccSnapshot[applied={T|T < 7334800256477995008 or (T in {7334800256477995008})}]
I20260929 22:58:38.870924 20223 mvcc.cc:205] Tried to move back new op lower bound from 7334800256477995008 to 7334800256373587968. Current Snapshot: MvccSnapshot[applied={T|T < 7334800256477995008}]
I20260929 22:58:38.872255 19735 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:38.872360 19735 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:38.873067 19735 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed0838c94baa4f859ad5a154627f7862: Sending DeleteTablet for 3 replicas of tablet c481855d00c74a87a83f32ff5ab04138
I20260929 22:58:38.873340 19861 tablet_service.cc:1514] Processing DeleteTablet for tablet c481855d00c74a87a83f32ff5ab04138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:38 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:60198
I20260929 22:58:38.873377 20129 tablet_service.cc:1514] Processing DeleteTablet for tablet c481855d00c74a87a83f32ff5ab04138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:38 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:34692
I20260929 22:58:38.873413 19995 tablet_service.cc:1514] Processing DeleteTablet for tablet c481855d00c74a87a83f32ff5ab04138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:38 UTC) from {username='kudu', principal='kudu/127.0.124.190@KRBTEST.COM'} at 127.0.0.1:55802
I20260929 22:58:38.873575 20233 tablet_replica.cc:330] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: stopping tablet replica
I20260929 22:58:38.873625 20234 tablet_replica.cc:330] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: stopping tablet replica
I20260929 22:58:38.873667 20233 raft_consensus.cc:2229] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:38.873709 20234 raft_consensus.cc:2229] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:38.873759 20233 raft_consensus.cc:2258] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:38.873795 20234 raft_consensus.cc:2258] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:38.873905 20232 tablet_replica.cc:330] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea: stopping tablet replica
I20260929 22:58:38.874027 20232 raft_consensus.cc:2229] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:58:38.874094 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19798
I20260929 22:58:38.874158 20232 raft_consensus.cc:2258] T c481855d00c74a87a83f32ff5ab04138 P 86d475c7c87e4888829ee8e9fad3edea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:38.874935 20233 ts_tablet_manager.cc:1905] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:38.876094 20234 ts_tablet_manager.cc:1905] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:38.876372 20233 ts_tablet_manager.cc:1918] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:38.876444 20233 log.cc:1196] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/c481855d00c74a87a83f32ff5ab04138
I20260929 22:58:38.876741 20233 ts_tablet_manager.cc:1939] T c481855d00c74a87a83f32ff5ab04138 P 46b89ea203fe4473a78c656006c83bbb: Deleting consensus metadata
I20260929 22:58:38.877172 19720 catalog_manager.cc:4841] TS 46b89ea203fe4473a78c656006c83bbb (127.0.124.131:36423): tablet c481855d00c74a87a83f32ff5ab04138 (table test-table [id=9bc2331859c24ff6a9c13c7896211a41]) successfully deleted
I20260929 22:58:38.877552 20234 ts_tablet_manager.cc:1918] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:38.877628 20234 log.cc:1196] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/c481855d00c74a87a83f32ff5ab04138
I20260929 22:58:38.877858 20234 ts_tablet_manager.cc:1939] T c481855d00c74a87a83f32ff5ab04138 P 9a188fc5753841c3bd2dddf13ee5069d: Deleting consensus metadata
I20260929 22:58:38.878226 19722 catalog_manager.cc:4841] TS 9a188fc5753841c3bd2dddf13ee5069d (127.0.124.130:45527): tablet c481855d00c74a87a83f32ff5ab04138 (table test-table [id=9bc2331859c24ff6a9c13c7896211a41]) successfully deleted
W20260929 22:58:38.881862 19719 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:40139 (error 108)
I20260929 22:58:38.882315 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:38.882204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:40139 (local address 127.0.0.1:60206)
0929 22:58:38.882258 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:38.882290 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:40139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:58:38.882422 19719 catalog_manager.cc:4584] TS 86d475c7c87e4888829ee8e9fad3edea (127.0.124.129:40139): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c481855d00c74a87a83f32ff5ab04138: Network error: Client connection negotiation failed: client connection to 127.0.124.129:40139: connect: Connection refused (error 111)
I20260929 22:58:38.882477 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19932
I20260929 22:58:38.887655 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20066
I20260929 22:58:38.891811 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 19703
2026-09-29T22:58:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1964 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-29T22:58:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:38Z Disabled control of system clock
I20260929 22:58:38.918601 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:43407
--webserver_interface=127.0.124.190
--webserver_port=0
--builtin_ntp_servers=127.0.124.148:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:43407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:38.996083 20239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:38.996294 20239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:38.996315 20239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:38.997385 20239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:38.997418 20239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:38.997430 20239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:38.997442 20239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:38.997454 20239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:38.998714 20239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:43407
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:43407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:38.998889 20239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:38.999104 20239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:39.003782 20247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.003794 20244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.003794 20245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:39.004078 20239 server_base.cc:1034] running on GCE node
I20260929 22:58:39.004338 20239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:39.004602 20239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:39.005752 20239 hybrid_clock.cc:648] HybridClock initialized: now 1790722719005741 us; error 30 us; skew 500 ppm
I20260929 22:58:39.006940 20239 webserver.cc:460] Webserver started at http://127.0.124.190:45257/ using document root <none> and password file <none>
I20260929 22:58:39.007210 20239 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:39.007280 20239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:39.007427 20239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:39.008522 20239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "2837771bf9804ac3ae2cd708ac4e781d"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "4528411ea9b387f95a9cf19a8b21dd5b"
server_key_iv: "cb89e5dd2792f72c662fbe9ae2dfe1e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.008858 20239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "2837771bf9804ac3ae2cd708ac4e781d"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "4528411ea9b387f95a9cf19a8b21dd5b"
server_key_iv: "cb89e5dd2792f72c662fbe9ae2dfe1e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.010178 20239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:39.010900 20253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.011073 20239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:39.011178 20239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "2837771bf9804ac3ae2cd708ac4e781d"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "4528411ea9b387f95a9cf19a8b21dd5b"
server_key_iv: "cb89e5dd2792f72c662fbe9ae2dfe1e7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.011258 20239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:39.027246 20239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:39.027556 20239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:39.027711 20239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:39.031641 20239 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:43407
I20260929 22:58:39.031674 20305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:43407 every 8 connection(s)
I20260929 22:58:39.032002 20239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:39.032472 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20239
I20260929 22:58:39.032588 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:39.032776 498 external_mini_cluster.cc:1428] Setting key 6f026b348399add370b6dbb0a10bf771
I20260929 22:58:39.033150 20306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:39.036530 20306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: Bootstrap starting.
I20260929 22:58:39.037199 20306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:39.037494 20306 log.cc:824] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:39.038290 20306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: No bootstrap required, opened a new log
I20260929 22:58:39.038707 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.033326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36134 (local address 127.0.124.190:43407)
0929 22:58:39.033547 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.033556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.033587 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:58:39.034076 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.034085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.034162 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.034328 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:39.034488 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.035786 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.036610 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.037231 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.037371 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.038042 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:39.038047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:39.038047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:39.038235 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:39.038274 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:39.038288 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:39.038356 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.038442 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.038512 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260929 22:58:39.040287 20306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } }
I20260929 22:58:39.040419 20306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:39.040441 20306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2837771bf9804ac3ae2cd708ac4e781d, State: Initialized, Role: FOLLOWER
I20260929 22:58:39.040552 20306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } }
I20260929 22:58:39.040616 20306 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:39.040635 20306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:39.040661 20306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:39.041145 20306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } }
I20260929 22:58:39.041224 20306 leader_election.cc:302] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2837771bf9804ac3ae2cd708ac4e781d; no voters:
I20260929 22:58:39.041342 20306 leader_election.cc:288] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:39.041417 20311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:39.041564 20311 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [term 1 LEADER]: Becoming Leader. State: Replica: 2837771bf9804ac3ae2cd708ac4e781d, State: Running, Role: LEADER
I20260929 22:58:39.041656 20306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:39.041693 20311 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } }
I20260929 22:58:39.042095 20313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2837771bf9804ac3ae2cd708ac4e781d. Latest consensus state: current_term: 1 leader_uuid: "2837771bf9804ac3ae2cd708ac4e781d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } } }
I20260929 22:58:39.042085 20312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2837771bf9804ac3ae2cd708ac4e781d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2837771bf9804ac3ae2cd708ac4e781d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 43407 } } }
I20260929 22:58:39.042222 20313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:39.042313 20312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:39.042626 20320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:39.043080 20320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:39.044566 20320 catalog_manager.cc:1347] Generated new cluster ID: 58199028600745bc84dd84f071ea057b
I20260929 22:58:39.044620 20320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:39.067176 20320 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:39.067663 20320 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:39.076704 20320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: Generated new TSK 0
I20260929 22:58:39.076897 20320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:39.078650 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.129:0
--local_ip_for_outbound_sockets=127.0.124.129
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--builtin_ntp_servers=127.0.124.148:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:58:39.185304 20330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:39.185528 20330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:39.185547 20330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:39.186707 20330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:39.186746 20330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:39.186769 20330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.129
I20260929 22:58:39.188061 20330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.124.129
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.129
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:39.188314 20330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:39.188622 20330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:39.193584 20336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.193601 20335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.193601 20338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:39.193820 20330 server_base.cc:1034] running on GCE node
I20260929 22:58:39.194221 20330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:39.194489 20330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:39.195657 20330 hybrid_clock.cc:648] HybridClock initialized: now 1790722719195640 us; error 34 us; skew 500 ppm
I20260929 22:58:39.196933 20330 webserver.cc:460] Webserver started at http://127.0.124.129:36715/ using document root <none> and password file <none>
I20260929 22:58:39.197176 20330 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:39.197221 20330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:39.197361 20330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:39.198391 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data/instance:
uuid: "c9d62829ac864733956dff09daceac2b"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "9cddca980a772fcec2a42cc915bf4635"
server_key_iv: "ad6a6188c3c1cd87eb160a1e39ebd047"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.198750 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal/instance:
uuid: "c9d62829ac864733956dff09daceac2b"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "9cddca980a772fcec2a42cc915bf4635"
server_key_iv: "ad6a6188c3c1cd87eb160a1e39ebd047"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.200081 20330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:58:39.200929 20344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.201095 20330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:39.201179 20330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal
uuid: "c9d62829ac864733956dff09daceac2b"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "9cddca980a772fcec2a42cc915bf4635"
server_key_iv: "ad6a6188c3c1cd87eb160a1e39ebd047"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.201232 20330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:39.212419 20330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:39.212661 20330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:39.212756 20330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:39.212918 20330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:39.213217 20330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:39.213249 20330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.213300 20330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:39.213325 20330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.219370 20330 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.129:38081
I20260929 22:58:39.219466 20457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.129:38081 every 8 connection(s)
I20260929 22:58:39.219753 20330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/data/info.pb
I20260929 22:58:39.224176 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20330
I20260929 22:58:39.224308 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-0/wal/instance
I20260929 22:58:39.224502 498 external_mini_cluster.cc:1428] Setting key b6f7e0b2205d05e4e88e06e33f956c1f
I20260929 22:58:39.225289 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.220548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.129:41767 (local address 127.0.124.190:43407)
0929 22:58:39.220640 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.220642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.220870 (+ 228us) server_negotiation.cc:407] Connection header received
0929 22:58:39.221416 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.221417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.221434 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.221499 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:39.222177 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.222711 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.223729 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.223955 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.224040 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.225018 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:39.225019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:39.225019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:39.225023 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:39.225038 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:39.225041 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:39.225082 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.225171 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.225210 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 22:58:39.225503 20460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.220522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:43407 (local address 127.0.124.129:41767)
0929 22:58:39.220742 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.220776 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.221299 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.221564 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.221568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.221578 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:39.222072 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.222076 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.222821 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.222822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.223617 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.223619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.224047 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.224049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.224187 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.224872 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:39.224873 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:39.224909 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:39.224935 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:39.225095 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:39.225098 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:39.225101 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.225171 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.225264 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
I20260929 22:58:39.225540 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.130:0
--local_ip_for_outbound_sockets=127.0.124.130
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--builtin_ntp_servers=127.0.124.148:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:58:39.226121 20458 heartbeater.cc:347] Connected to a master server at 127.0.124.190:43407
I20260929 22:58:39.226219 20458 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:39.226397 20458 heartbeater.cc:511] Master 127.0.124.190:43407 requested a full tablet report, sending...
I20260929 22:58:39.226872 20270 ts_manager.cc:194] Registered new tserver with Master: c9d62829ac864733956dff09daceac2b (127.0.124.129:38081)
I20260929 22:58:39.227490 20270 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.129:41767
W20260929 22:58:39.305337 20461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:39.305538 20461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:39.305560 20461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:39.306591 20461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:39.306622 20461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:39.306645 20461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.130
I20260929 22:58:39.307910 20461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.124.130
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.130
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:39.308080 20461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:39.308312 20461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:39.313020 20466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.313046 20467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.313076 20469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:39.313238 20461 server_base.cc:1034] running on GCE node
I20260929 22:58:39.313467 20461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:39.313699 20461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:39.314849 20461 hybrid_clock.cc:648] HybridClock initialized: now 1790722719314832 us; error 49 us; skew 500 ppm
I20260929 22:58:39.315928 20461 webserver.cc:460] Webserver started at http://127.0.124.130:36489/ using document root <none> and password file <none>
I20260929 22:58:39.316256 20461 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:39.316321 20461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:39.316457 20461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:39.317479 20461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data/instance:
uuid: "7f24a6b875d546f18a736b3775fa2b75"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "3322874fa9618bb1c3981c9b87b5e9f9"
server_key_iv: "95da0d61175631a0ae4d505300f08d1c"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.317817 20461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal/instance:
uuid: "7f24a6b875d546f18a736b3775fa2b75"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "3322874fa9618bb1c3981c9b87b5e9f9"
server_key_iv: "95da0d61175631a0ae4d505300f08d1c"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.319090 20461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:39.319749 20475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.320017 20461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:39.320122 20461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal
uuid: "7f24a6b875d546f18a736b3775fa2b75"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "3322874fa9618bb1c3981c9b87b5e9f9"
server_key_iv: "95da0d61175631a0ae4d505300f08d1c"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.320253 20461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:39.331454 20461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:39.331712 20461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:39.331852 20461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:39.332043 20461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:39.332422 20461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:39.332474 20461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.332513 20461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:39.332540 20461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.338456 20461 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.130:39557
I20260929 22:58:39.338505 20588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.130:39557 every 8 connection(s)
I20260929 22:58:39.338814 20461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/data/info.pb
I20260929 22:58:39.340557 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20461
I20260929 22:58:39.340646 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal/instance
I20260929 22:58:39.340840 498 external_mini_cluster.cc:1428] Setting key 1908ad65834ba19be9b236b1ad9fc3d3
I20260929 22:58:39.341804 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.124.131:0
--local_ip_for_outbound_sockets=127.0.124.131
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--builtin_ntp_servers=127.0.124.148:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:58:39.344575 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.339513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.130:34421 (local address 127.0.124.190:43407)
0929 22:58:39.339593 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.339595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.339769 (+ 174us) server_negotiation.cc:407] Connection header received
0929 22:58:39.340272 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.340274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.340283 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.340335 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:39.341150 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.341827 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.343109 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.343331 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.343406 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.344342 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:39.344343 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:39.344343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:39.344347 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:39.344361 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:39.344365 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:39.344405 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.344497 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.344519 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 22:58:39.344856 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.339468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:43407 (local address 127.0.124.130:34421)
0929 22:58:39.339661 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.339691 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.340139 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.340383 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.340386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.340393 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:39.341022 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.341030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.341930 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.341931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.343013 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.343016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.343423 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.343424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.343582 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.344163 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:39.344164 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:39.344201 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:39.344250 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:39.344421 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:39.344427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:39.344430 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.344496 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.344605 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260929 22:58:39.345356 20589 heartbeater.cc:347] Connected to a master server at 127.0.124.190:43407
I20260929 22:58:39.345443 20589 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:39.345623 20589 heartbeater.cc:511] Master 127.0.124.190:43407 requested a full tablet report, sending...
I20260929 22:58:39.345979 20270 ts_manager.cc:194] Registered new tserver with Master: 7f24a6b875d546f18a736b3775fa2b75 (127.0.124.130:39557)
I20260929 22:58:39.346298 20270 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.130:34421
W20260929 22:58:39.420943 20592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:39.421175 20592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:39.421211 20592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:39.422371 20592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:39.422432 20592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:39.422474 20592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.124.131
I20260929 22:58:39.423866 20592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.124.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.124.131
--webserver_port=0
--tserver_master_addrs=127.0.124.190:43407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.124.131
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:39.424127 20592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:39.424431 20592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:39.429368 20597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.429380 20600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:39.429414 20598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:39.429570 20592 server_base.cc:1034] running on GCE node
I20260929 22:58:39.429880 20592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:39.430076 20592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:39.431209 20592 hybrid_clock.cc:648] HybridClock initialized: now 1790722719431200 us; error 28 us; skew 500 ppm
I20260929 22:58:39.432565 20592 webserver.cc:460] Webserver started at http://127.0.124.131:37829/ using document root <none> and password file <none>
I20260929 22:58:39.432824 20592 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:39.432896 20592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:39.433048 20592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:39.434077 20592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data/instance:
uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "80aa6c52241065b5c0ff235643df3cac"
server_key_iv: "d27cc3a4a105a39f868045453143e0b7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.434553 20592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal/instance:
uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "80aa6c52241065b5c0ff235643df3cac"
server_key_iv: "d27cc3a4a105a39f868045453143e0b7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.435770 20592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:39.436463 20606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.436648 20592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.436717 20592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal
uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4"
format_stamp: "Formatted at 2026-09-29 22:58:39 on dist-test-slave-512q"
server_key: "80aa6c52241065b5c0ff235643df3cac"
server_key_iv: "d27cc3a4a105a39f868045453143e0b7"
server_key_version: "encryptionkey@0"
I20260929 22:58:39.436769 20592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:39.447829 20592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:39.448056 20592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:39.448153 20592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:39.448364 20592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:58:39.448626 20592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:58:39.448655 20592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.448675 20592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:58:39.448688 20592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:39.454224 20592 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.131:46789
I20260929 22:58:39.454264 20719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.131:46789 every 8 connection(s)
I20260929 22:58:39.454563 20592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/data/info.pb
I20260929 22:58:39.457278 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20592
I20260929 22:58:39.457379 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal/instance
I20260929 22:58:39.457553 498 external_mini_cluster.cc:1428] Setting key aa8046780e3a4f9fead5097c69f51686
I20260929 22:58:39.459806 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.455254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:45733 (local address 127.0.124.190:43407)
0929 22:58:39.455315 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.455317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.455524 (+ 207us) server_negotiation.cc:407] Connection header received
0929 22:58:39.456045 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.456046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.456060 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.456122 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:39.456844 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.457578 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.458571 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.458750 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.458803 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.459599 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:39.459600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:39.459600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:39.459604 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:39.459613 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:39.459616 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:39.459656 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.459735 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.459752 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:58:39.460094 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.455246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:43407 (local address 127.0.124.131:45733)
0929 22:58:39.455413 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.455444 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.455939 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.456196 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.456199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.456240 (+ 41us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:58:39.456752 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.456758 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.457681 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.457682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.458497 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.458500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.458825 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.458825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.458928 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.459481 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:58:39.459481 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:58:39.459508 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:58:39.459531 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:58:39.459669 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:58:39.459673 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:58:39.459676 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.459739 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.459813 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260929 22:58:39.460574 20720 heartbeater.cc:347] Connected to a master server at 127.0.124.190:43407
I20260929 22:58:39.460647 20720 heartbeater.cc:464] Registering TS with master...
I20260929 22:58:39.460777 20720 heartbeater.cc:511] Master 127.0.124.190:43407 requested a full tablet report, sending...
I20260929 22:58:39.461094 20270 ts_manager.cc:194] Registered new tserver with Master: 10ff8b5cb8ab4f4f923178e75f1fa7c4 (127.0.124.131:46789)
I20260929 22:58:39.461406 20270 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.124.131:45733
I20260929 22:58:39.469214 498 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:58:39.474900 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.471572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.0.124.190:43407)
0929 22:58:39.471657 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.471659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.471668 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:39.471691 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.471691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.471701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.471760 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:39.471985 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.472735 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.473853 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.474032 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.474088 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.474745 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:39.474745 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:39.474746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:39.474749 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:39.474760 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:39.474763 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:39.474800 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.474832 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.474848 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260929 22:58:39.476322 20270 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:58:39.477819 20270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:58:39.484236 20733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.480312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33174 (local address 127.0.124.129:38081)
0929 22:58:39.480488 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.480491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.480679 (+ 188us) server_negotiation.cc:407] Connection header received
0929 22:58:39.480746 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.480748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.480763 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.480837 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:39.480988 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.482004 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483104 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.483825 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483907 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484000 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.484098 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.484132 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
I20260929 22:58:39.484257 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.479877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38081 (local address 127.0.0.1:33174)
0929 22:58:39.480632 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.480639 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.480678 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.480848 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.480849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.480852 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:39.480890 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.480892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.482082 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.482083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.483012 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.483015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.483918 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.483992 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484005 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.484085 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.484132 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":30,"thread_start_us":90,"threads_started":1}
I20260929 22:58:39.484274 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.479868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39557 (local address 127.0.0.1:40574)
0929 22:58:39.480488 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.480497 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.480556 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.480995 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.480995 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.480997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:39.481024 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.481025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.481876 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.481877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.483101 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.483103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.483947 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.484012 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484016 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.484059 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.484116 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":45,"thread_start_us":94,"threads_started":1}
I20260929 22:58:39.484439 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.480141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.0.124.131:46789)
0929 22:58:39.480320 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.480325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.480334 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:58:39.480369 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.480371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.480390 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.480651 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:39.480706 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.481787 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483368 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.483841 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483925 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484007 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.484304 (+ 297us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.484349 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260929 22:58:39.484642 20728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.479867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.131:46789 (local address 127.0.0.1:60946)
0929 22:58:39.479973 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.480010 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.480103 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.480507 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.480510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.480513 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:39.480579 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.480580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.482236 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.482236 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.483285 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.483286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.484041 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.484042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.484103 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484105 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.484151 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.484184 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":63,"threads_started":1}
I20260929 22:58:39.484977 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.480150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40574 (local address 127.0.124.130:39557)
0929 22:58:39.480795 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.480798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.480805 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:58:39.480860 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.480862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.480882 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.481091 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:39.481133 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.481790 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.483176 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.483853 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.484316 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.484823 (+ 507us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.484851 (+ 28us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.484893 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":113,"threads_started":1}
I20260929 22:58:39.485356 20392 tablet_service.cc:1467] Processing CreateTablet for tablet 1b976e7f18c74d1c86efc92febd8527e (DEFAULT_TABLE table=test-table [id=798d1f906ae444cd90829e5d5906f183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:39.485361 20654 tablet_service.cc:1467] Processing CreateTablet for tablet 1b976e7f18c74d1c86efc92febd8527e (DEFAULT_TABLE table=test-table [id=798d1f906ae444cd90829e5d5906f183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:39.485704 20392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b976e7f18c74d1c86efc92febd8527e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:39.485704 20654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b976e7f18c74d1c86efc92febd8527e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:39.485692 20523 tablet_service.cc:1467] Processing CreateTablet for tablet 1b976e7f18c74d1c86efc92febd8527e (DEFAULT_TABLE table=test-table [id=798d1f906ae444cd90829e5d5906f183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:58:39.485985 20523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b976e7f18c74d1c86efc92febd8527e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:39.488243 20734 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Bootstrap starting.
I20260929 22:58:39.488894 20734 tablet_bootstrap.cc:654] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:39.488950 20735 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Bootstrap starting.
I20260929 22:58:39.489229 20734 log.cc:824] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:39.489253 20736 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Bootstrap starting.
I20260929 22:58:39.489543 20735 tablet_bootstrap.cc:654] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:39.489817 20736 tablet_bootstrap.cc:654] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:39.489858 20735 log.cc:824] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:39.490031 20734 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: No bootstrap required, opened a new log
I20260929 22:58:39.490104 20734 ts_tablet_manager.cc:1397] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:39.490183 20736 log.cc:824] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:39.490597 20735 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: No bootstrap required, opened a new log
I20260929 22:58:39.490691 20735 ts_tablet_manager.cc:1397] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:39.490849 20736 tablet_bootstrap.cc:492] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: No bootstrap required, opened a new log
I20260929 22:58:39.490896 20736 ts_tablet_manager.cc:1397] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:58:39.492740 20734 raft_consensus.cc:348] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.492914 20734 raft_consensus.cc:374] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:39.492826 20736 raft_consensus.cc:348] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.492949 20734 raft_consensus.cc:729] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d62829ac864733956dff09daceac2b, State: Initialized, Role: FOLLOWER
I20260929 22:58:39.492980 20736 raft_consensus.cc:374] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:39.493014 20736 raft_consensus.cc:729] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f24a6b875d546f18a736b3775fa2b75, State: Initialized, Role: FOLLOWER
I20260929 22:58:39.493126 20736 consensus_queue.cc:260] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.493091 20734 consensus_queue.cc:260] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.493184 20735 raft_consensus.cc:348] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.493335 20735 raft_consensus.cc:374] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:39.493364 20735 raft_consensus.cc:729] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ff8b5cb8ab4f4f923178e75f1fa7c4, State: Initialized, Role: FOLLOWER
I20260929 22:58:39.493379 20734 ts_tablet_manager.cc:1428] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 22:58:39.493379 20736 ts_tablet_manager.cc:1428] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:58:39.493392 20589 heartbeater.cc:503] Master 127.0.124.190:43407 was elected leader, sending a full tablet report...
I20260929 22:58:39.493477 20458 heartbeater.cc:503] Master 127.0.124.190:43407 was elected leader, sending a full tablet report...
I20260929 22:58:39.493485 20735 consensus_queue.cc:260] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.493743 20735 ts_tablet_manager.cc:1428] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:58:39.493785 20720 heartbeater.cc:503] Master 127.0.124.190:43407 was elected leader, sending a full tablet report...
W20260929 22:58:39.589502 20590 tablet.cc:2369] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:39.705112 20721 tablet.cc:2369] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:58:39.720554 20459 tablet.cc:2369] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:58:39.816591 20742 raft_consensus.cc:482] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:58:39.816756 20742 raft_consensus.cc:504] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.817160 20742 leader_election.cc:288] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f24a6b875d546f18a736b3775fa2b75 (127.0.124.130:39557), c9d62829ac864733956dff09daceac2b (127.0.124.129:38081)
I20260929 22:58:39.821038 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.817469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:40323 (local address 127.0.124.130:39557)
0929 22:58:39.817574 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.817576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.817586 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:58:39.817620 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.817621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.817641 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.817702 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:39.817889 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.818635 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820091 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.820652 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820757 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.820766 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.820899 (+ 133us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.820966 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260929 22:58:39.821036 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.817297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.130:39557 (local address 127.0.124.131:40323)
0929 22:58:39.817348 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.817359 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.817400 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.817706 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.817707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.817709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:39.817803 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.817806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.818757 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.818758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.819977 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.819980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.820757 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.820831 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.820835 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.820890 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.820945 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:58:39.821062 20733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.817512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.124.131:47947 (local address 127.0.124.129:38081)
0929 22:58:39.817564 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.817566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.817646 (+ 80us) server_negotiation.cc:407] Connection header received
0929 22:58:39.817744 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.817745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.817755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.817784 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:58:39.817999 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.818666 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820082 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.820691 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820797 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.820805 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.820960 (+ 155us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.821000 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:58:39.821043 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.817346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38081 (local address 127.0.124.131:47947)
0929 22:58:39.817575 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.817584 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:58:39.817671 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:58:39.817848 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:58:39.817848 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:58:39.817850 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:58:39.817916 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.817918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.818753 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.818754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.819978 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:58:39.819980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.820822 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.820823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:58:39.820888 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.820891 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:58:39.820944 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:58:39.820970 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":10,"thread_start_us":97,"threads_started":1}
I20260929 22:58:39.821424 20412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b976e7f18c74d1c86efc92febd8527e" candidate_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d62829ac864733956dff09daceac2b" is_pre_election: true
I20260929 22:58:39.821444 20543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b976e7f18c74d1c86efc92febd8527e" candidate_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f24a6b875d546f18a736b3775fa2b75" is_pre_election: true
I20260929 22:58:39.821559 20543 raft_consensus.cc:2454] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ff8b5cb8ab4f4f923178e75f1fa7c4 in term 0.
I20260929 22:58:39.821564 20412 raft_consensus.cc:2454] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ff8b5cb8ab4f4f923178e75f1fa7c4 in term 0.
I20260929 22:58:39.821784 20610 leader_election.cc:302] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ff8b5cb8ab4f4f923178e75f1fa7c4, c9d62829ac864733956dff09daceac2b; no voters:
I20260929 22:58:39.821923 20742 raft_consensus.cc:2781] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:58:39.821971 20742 raft_consensus.cc:482] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:58:39.821988 20742 raft_consensus.cc:3037] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:39.822779 20742 raft_consensus.cc:504] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.822932 20742 leader_election.cc:288] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [CANDIDATE]: Term 1 election: Requested vote from peers 7f24a6b875d546f18a736b3775fa2b75 (127.0.124.130:39557), c9d62829ac864733956dff09daceac2b (127.0.124.129:38081)
I20260929 22:58:39.823091 20543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b976e7f18c74d1c86efc92febd8527e" candidate_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f24a6b875d546f18a736b3775fa2b75"
I20260929 22:58:39.823130 20412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b976e7f18c74d1c86efc92febd8527e" candidate_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d62829ac864733956dff09daceac2b"
I20260929 22:58:39.823202 20412 raft_consensus.cc:3037] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:39.823207 20543 raft_consensus.cc:3037] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:39.823976 20412 raft_consensus.cc:2454] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ff8b5cb8ab4f4f923178e75f1fa7c4 in term 1.
I20260929 22:58:39.823987 20543 raft_consensus.cc:2454] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ff8b5cb8ab4f4f923178e75f1fa7c4 in term 1.
I20260929 22:58:39.824121 20610 leader_election.cc:302] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ff8b5cb8ab4f4f923178e75f1fa7c4, c9d62829ac864733956dff09daceac2b; no voters:
I20260929 22:58:39.824200 20742 raft_consensus.cc:2781] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:39.824378 20742 raft_consensus.cc:686] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 1 LEADER]: Becoming Leader. State: Replica: 10ff8b5cb8ab4f4f923178e75f1fa7c4, State: Running, Role: LEADER
I20260929 22:58:39.824470 20742 consensus_queue.cc:237] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } }
I20260929 22:58:39.825287 20270 catalog_manager.cc:5495] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10ff8b5cb8ab4f4f923178e75f1fa7c4 (127.0.124.131). New cstate: current_term: 1 leader_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ff8b5cb8ab4f4f923178e75f1fa7c4" member_type: VOTER last_known_addr { host: "127.0.124.131" port: 46789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 } health_report { overall_health: UNKNOWN } } }
I20260929 22:58:39.834962 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.832914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60962 (local address 127.0.124.131:46789)
0929 22:58:39.832974 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:39.832976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:39.832984 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:58:39.833028 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:39.833029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:39.833057 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:39.833112 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:58:39.833234 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.833666 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.834342 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:39.834508 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:39.834555 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:39.834675 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:58:39.834759 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:58:39.834816 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:39.834846 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 22:58:39.834859 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:58:39.836613 20412 raft_consensus.cc:1261] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 1 FOLLOWER]: Refusing update from remote peer 10ff8b5cb8ab4f4f923178e75f1fa7c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:39.836593 20543 raft_consensus.cc:1261] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 1 FOLLOWER]: Refusing update from remote peer 10ff8b5cb8ab4f4f923178e75f1fa7c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:58:39.836966 20742 consensus_queue.cc:1035] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f24a6b875d546f18a736b3775fa2b75" member_type: VOTER last_known_addr { host: "127.0.124.130" port: 39557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:39.837108 20744 consensus_queue.cc:1035] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d62829ac864733956dff09daceac2b" member_type: VOTER last_known_addr { host: "127.0.124.129" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:58:39.840390 20748 mvcc.cc:205] Tried to move back new op lower bound from 7334800260448264192 to 7334800260401729536. Current Snapshot: MvccSnapshot[applied={T|T < 7334800260448264192}]
I20260929 22:58:39.841988 20270 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:39.842098 20270 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:58:39.842905 20270 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2837771bf9804ac3ae2cd708ac4e781d: Sending DeleteTablet for 3 replicas of tablet 1b976e7f18c74d1c86efc92febd8527e
I20260929 22:58:39.843204 20523 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b976e7f18c74d1c86efc92febd8527e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:39 UTC) from {username='slave'} at 127.0.0.1:40574
I20260929 22:58:39.843207 20392 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b976e7f18c74d1c86efc92febd8527e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:39 UTC) from {username='slave'} at 127.0.0.1:33174
I20260929 22:58:39.843420 20758 tablet_replica.cc:330] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b: stopping tablet replica
I20260929 22:58:39.843425 20654 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b976e7f18c74d1c86efc92febd8527e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:58:39 UTC) from {username='slave'} at 127.0.0.1:60946
I20260929 22:58:39.843526 20758 raft_consensus.cc:2229] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:39.843644 20758 raft_consensus.cc:2258] T 1b976e7f18c74d1c86efc92febd8527e P c9d62829ac864733956dff09daceac2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:39.843647 20759 tablet_replica.cc:330] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: stopping tablet replica
I20260929 22:58:39.843791 20757 tablet_replica.cc:330] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: stopping tablet replica
I20260929 22:58:39.843792 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20330
I20260929 22:58:39.843811 20759 raft_consensus.cc:2229] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:58:39.844698 20757 raft_consensus.cc:2229] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:58:39.844811 20757 raft_consensus.cc:2258] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:39.845275 20759 raft_consensus.cc:2258] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:58:39.845721 20759 ts_tablet_manager.cc:1905] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:39.845760 20757 ts_tablet_manager.cc:1905] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:58:39.847216 20759 ts_tablet_manager.cc:1918] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:39.847225 20757 ts_tablet_manager.cc:1918] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:58:39.847292 20759 log.cc:1196] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-2/wal/wals/1b976e7f18c74d1c86efc92febd8527e
I20260929 22:58:39.847308 20757 log.cc:1196] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Deleting WAL directory at /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790722483574547-498-0/minicluster-data/ts-1/wal/wals/1b976e7f18c74d1c86efc92febd8527e
I20260929 22:58:39.847548 20759 ts_tablet_manager.cc:1939] T 1b976e7f18c74d1c86efc92febd8527e P 10ff8b5cb8ab4f4f923178e75f1fa7c4: Deleting consensus metadata
I20260929 22:58:39.847558 20757 ts_tablet_manager.cc:1939] T 1b976e7f18c74d1c86efc92febd8527e P 7f24a6b875d546f18a736b3775fa2b75: Deleting consensus metadata
I20260929 22:58:39.847944 20256 catalog_manager.cc:4841] TS 7f24a6b875d546f18a736b3775fa2b75 (127.0.124.130:39557): tablet 1b976e7f18c74d1c86efc92febd8527e (table test-table [id=798d1f906ae444cd90829e5d5906f183]) successfully deleted
I20260929 22:58:39.847944 20255 catalog_manager.cc:4841] TS 10ff8b5cb8ab4f4f923178e75f1fa7c4 (127.0.124.131:46789): tablet 1b976e7f18c74d1c86efc92febd8527e (table test-table [id=798d1f906ae444cd90829e5d5906f183]) successfully deleted
W20260929 22:58:39.848973 20257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.124.129:38081 (error 108)
I20260929 22:58:39.849459 20728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:39.849337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.129:38081 (local address 127.0.0.1:33176)
0929 22:58:39.849384 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:58:39.849421 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 22:58:39.849540 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20461
W20260929 22:58:39.849555 20257 catalog_manager.cc:4584] TS c9d62829ac864733956dff09daceac2b (127.0.124.129:38081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b976e7f18c74d1c86efc92febd8527e: Network error: Client connection negotiation failed: client connection to 127.0.124.129:38081: connect: Connection refused (error 111)
I20260929 22:58:39.854625 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20592
I20260929 22:58:39.859562 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20239
2026-09-29T22:58:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (967 ms)
[----------] 6 tests from EncryptionPolicyTest (8845 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:39 dist-test-slave-512q krb5kdc[20763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:39 dist-test-slave-512q krb5kdc[20763](info): set up 2 sockets
Sep 29 22:58:39 dist-test-slave-512q krb5kdc[20763](info): commencing operation
krb5kdc: starting...
W20260929 22:58:40.894486 498 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:40 dist-test-slave-512q krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:41.007325 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41441
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:41.085402 20776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:41.085600 20776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:41.085623 20776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:41.086771 20776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:41.086813 20776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:41.086827 20776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:41.086884 20776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:41.086907 20776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:41.088369 20776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:41.088613 20776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:41.088843 20776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:41.093604 20784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:41.093680 20782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:41.093604 20781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:41.093865 20776 server_base.cc:1034] running on GCE node
I20260929 22:58:41.094115 20776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:41.094352 20776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:41.095484 20776 hybrid_clock.cc:648] HybridClock initialized: now 1790722721095463 us; error 42 us; skew 500 ppm
Sep 29 22:58:41 dist-test-slave-512q krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722721, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:41.098007 20776 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:41.098412 20776 webserver.cc:460] Webserver started at http://127.0.0.1:35311/ using document root <none> and password file <none>
I20260929 22:58:41.098640 20776 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:41.098708 20776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:41.098855 20776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:41.099890 20776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "bc74e0bd9f5048b180818e0b53e95d44"
format_stamp: "Formatted at 2026-09-29 22:58:41 on dist-test-slave-512q"
server_key: "e481117817bc2aadfc385ec177b89548"
server_key_iv: "1c2e03824903b46b864fb7d769e81a41"
server_key_version: "encryptionkey@0"
I20260929 22:58:41.100313 20776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "bc74e0bd9f5048b180818e0b53e95d44"
format_stamp: "Formatted at 2026-09-29 22:58:41 on dist-test-slave-512q"
server_key: "e481117817bc2aadfc385ec177b89548"
server_key_iv: "1c2e03824903b46b864fb7d769e81a41"
server_key_version: "encryptionkey@0"
I20260929 22:58:41.101697 20776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:41.102442 20791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:41.102622 20776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:41.102717 20776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "bc74e0bd9f5048b180818e0b53e95d44"
format_stamp: "Formatted at 2026-09-29 22:58:41 on dist-test-slave-512q"
server_key: "e481117817bc2aadfc385ec177b89548"
server_key_iv: "1c2e03824903b46b864fb7d769e81a41"
server_key_version: "encryptionkey@0"
I20260929 22:58:41.102797 20776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:41.116834 20776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:41.118644 20776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:41.118808 20776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:41.122655 20776 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41441
I20260929 22:58:41.122696 20843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41441 every 8 connection(s)
I20260929 22:58:41.123062 20776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:41.123909 20844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:41.126176 20844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: Bootstrap starting.
I20260929 22:58:41.126734 20844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:41.127018 20844 log.cc:824] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:41.127724 20844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: No bootstrap required, opened a new log
I20260929 22:58:41.129417 20844 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } }
I20260929 22:58:41.129558 20844 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:41.129581 20844 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc74e0bd9f5048b180818e0b53e95d44, State: Initialized, Role: FOLLOWER
I20260929 22:58:41.129781 20844 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } }
I20260929 22:58:41.129865 20844 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:41.129909 20844 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:41.129958 20844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:41.130501 20844 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } }
I20260929 22:58:41.130612 20844 leader_election.cc:302] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc74e0bd9f5048b180818e0b53e95d44; no voters:
I20260929 22:58:41.130787 20844 leader_election.cc:288] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:41.130856 20847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:41.131002 20847 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [term 1 LEADER]: Becoming Leader. State: Replica: bc74e0bd9f5048b180818e0b53e95d44, State: Running, Role: LEADER
I20260929 22:58:41.131042 20844 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:41.131105 20847 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } }
I20260929 22:58:41.131393 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20776
I20260929 22:58:41.131510 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:41.131734 498 external_mini_cluster.cc:1428] Setting key ceab3b523d960087d61274eb5d92bf62
I20260929 22:58:41.132344 20849 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc74e0bd9f5048b180818e0b53e95d44. Latest consensus state: current_term: 1 leader_uuid: "bc74e0bd9f5048b180818e0b53e95d44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } } }
I20260929 22:58:41.132447 20849 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:41.132643 20848 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc74e0bd9f5048b180818e0b53e95d44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc74e0bd9f5048b180818e0b53e95d44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41441 } } }
I20260929 22:58:41.133002 20848 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44 [sys.catalog]: This master's current role is: LEADER
W20260929 22:58:41.133142 20864 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:58:41.133198 20864 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:58:41.133249 20863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:41.133416 20863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:41.134965 20863 catalog_manager.cc:1347] Generated new cluster ID: 427c898ad22f46ce8a6fe39b362570c0
I20260929 22:58:41.135016 20863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:58:41 dist-test-slave-512q krb5kdc[20763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:58:41.144037 20859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:41.132271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42199 (local address 127.0.0.1:41441)
0929 22:58:41.132447 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:41.132457 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:41.133007 (+ 550us) server_negotiation.cc:407] Connection header received
0929 22:58:41.133136 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:41.133145 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:41.133204 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:41.133343 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:41.134129 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:41.135504 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:41.136612 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:41.137200 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:41.137314 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:41.140145 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:41.140151 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:41.140151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:41.140165 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:41.142266 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:41.142703 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:41.142707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:41.142707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:41.142832 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:41.143072 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:41.143073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:41.143074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:41.143411 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:41.143580 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:41.143702 (+ 122us) server_negotiation.cc:299] Negotiation successful
0929 22:58:41.143809 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260929 22:58:41.145053 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:41.153954 20859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:41.146467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49477 (local address 127.0.0.1:41441)
0929 22:58:41.146503 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:41.146505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:41.146638 (+ 133us) server_negotiation.cc:407] Connection header received
0929 22:58:41.146697 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:41.146698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:41.146707 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:41.146792 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:41.147437 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:41.148180 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:41.149210 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:41.149513 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:41.149573 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:41.151067 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:41.151069 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:41.151069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:41.151076 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:41.152696 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:41.153124 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:41.153125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:41.153125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:41.153194 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:41.153431 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:41.153432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:41.153432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:41.153548 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:41.153642 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:41.153804 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 22:58:41.153864 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:58:41.154738 20863 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:41.155221 20863 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:41.157011 20863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc74e0bd9f5048b180818e0b53e95d44: Generated new TSK 0
I20260929 22:58:41.157233 20863 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:41.161479 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20776
W20260929 22:58:41.165519 20761 connection.cc:535] client connection to 127.0.0.1:41441 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41441): Connection reset by peer (error 104)
2026-09-29T22:58:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:41 dist-test-slave-512q krb5kdc[20875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:41 dist-test-slave-512q krb5kdc[20875](info): set up 2 sockets
Sep 29 22:58:41 dist-test-slave-512q krb5kdc[20875](info): commencing operation
krb5kdc: starting...
W20260929 22:58:42.186924 498 mini_kdc.cc:121] Time spent starting KDC: real 1.008s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:42 dist-test-slave-512q krb5kdc[20875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:42.299376 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39215
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:42.379474 20888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:42.379693 20888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:42.379729 20888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:42.380870 20888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:42.380939 20888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:42.380975 20888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:42.381001 20888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:42.381031 20888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:42.382491 20888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39215
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:42.382745 20888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:42.382949 20888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:42.387563 20893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:42.387595 20896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:42.387573 20894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:42.387771 20888 server_base.cc:1034] running on GCE node
I20260929 22:58:42.388012 20888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:42.388304 20888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:42.389441 20888 hybrid_clock.cc:648] HybridClock initialized: now 1790722722389424 us; error 31 us; skew 500 ppm
Sep 29 22:58:42 dist-test-slave-512q krb5kdc[20875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722722, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:42.391750 20888 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:42.392201 20888 webserver.cc:460] Webserver started at http://127.0.0.1:36967/ using document root <none> and password file <none>
I20260929 22:58:42.392484 20888 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:42.392549 20888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:42.392686 20888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:42.393649 20888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "da412c556c534f7797dbf24222cd5cbc"
format_stamp: "Formatted at 2026-09-29 22:58:42 on dist-test-slave-512q"
server_key: "8bc500844639ef413dec0816d409a85c"
server_key_iv: "602f86244cad11be10950c1e5ca36f53"
server_key_version: "encryptionkey@0"
I20260929 22:58:42.393965 20888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "da412c556c534f7797dbf24222cd5cbc"
format_stamp: "Formatted at 2026-09-29 22:58:42 on dist-test-slave-512q"
server_key: "8bc500844639ef413dec0816d409a85c"
server_key_iv: "602f86244cad11be10950c1e5ca36f53"
server_key_version: "encryptionkey@0"
I20260929 22:58:42.395164 20888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:42.395821 20903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:42.395995 20888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:42.396097 20888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "da412c556c534f7797dbf24222cd5cbc"
format_stamp: "Formatted at 2026-09-29 22:58:42 on dist-test-slave-512q"
server_key: "8bc500844639ef413dec0816d409a85c"
server_key_iv: "602f86244cad11be10950c1e5ca36f53"
server_key_version: "encryptionkey@0"
I20260929 22:58:42.396178 20888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:42.405018 20888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:42.406778 20888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:42.406929 20888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:42.410697 20888 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39215
I20260929 22:58:42.410727 20955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39215 every 8 connection(s)
I20260929 22:58:42.411049 20888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:42.411830 20956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:42.413806 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 20888
I20260929 22:58:42.413952 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:42.414156 498 external_mini_cluster.cc:1428] Setting key a1ef2aae6c13c56b17c6223cfe238276
I20260929 22:58:42.414322 20956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc: Bootstrap starting.
I20260929 22:58:42.414978 20956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:42.415272 20956 log.cc:824] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:42.415917 20956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc: No bootstrap required, opened a new log
I20260929 22:58:42.417678 20956 raft_consensus.cc:348] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260929 22:58:42.417798 20956 raft_consensus.cc:374] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:42.417819 20956 raft_consensus.cc:729] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da412c556c534f7797dbf24222cd5cbc, State: Initialized, Role: FOLLOWER
I20260929 22:58:42.417943 20956 consensus_queue.cc:260] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260929 22:58:42.417999 20956 raft_consensus.cc:388] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:42.418037 20956 raft_consensus.cc:482] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:42.418081 20956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:42.418632 20956 raft_consensus.cc:504] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260929 22:58:42.418738 20956 leader_election.cc:302] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da412c556c534f7797dbf24222cd5cbc; no voters:
I20260929 22:58:42.418902 20956 leader_election.cc:288] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:42.418978 20961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:42.419147 20961 raft_consensus.cc:686] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [term 1 LEADER]: Becoming Leader. State: Replica: da412c556c534f7797dbf24222cd5cbc, State: Running, Role: LEADER
I20260929 22:58:42.419155 20956 sys_catalog.cc:564] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:42.419274 20961 consensus_queue.cc:237] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260929 22:58:42.419636 20962 sys_catalog.cc:455] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da412c556c534f7797dbf24222cd5cbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } } }
I20260929 22:58:42.419625 20961 sys_catalog.cc:455] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader da412c556c534f7797dbf24222cd5cbc. Latest consensus state: current_term: 1 leader_uuid: "da412c556c534f7797dbf24222cd5cbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da412c556c534f7797dbf24222cd5cbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } } }
I20260929 22:58:42.419772 20961 sys_catalog.cc:458] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:42.419799 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:42.414644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37435 (local address 127.0.0.1:39215)
0929 22:58:42.414840 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:42.414850 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:42.414883 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:58:42.415398 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:42.415407 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:42.415462 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:42.415615 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:42.415822 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:42.416805 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:42.417616 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:42.418161 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:42.418266 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:42.418930 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:42.418933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:42.418934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:42.419128 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:42.419164 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:42.419178 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:42.419454 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:42.419517 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 22:58:42.419546 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260929 22:58:42.419745 20962 sys_catalog.cc:458] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:42.420022 20968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:42.420548 20968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:42.420680 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:42.422700 20968 catalog_manager.cc:1347] Generated new cluster ID: 2f8c043335be4131b270010b7ce5049d
I20260929 22:58:42.422780 20968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:42.425220 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:42.422112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57807 (local address 127.0.0.1:39215)
0929 22:58:42.422143 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:42.422144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:42.422476 (+ 332us) server_negotiation.cc:407] Connection header received
0929 22:58:42.422521 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:42.422522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:42.422532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:42.422588 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:42.422828 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:42.423301 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:42.424020 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:42.424282 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:42.424350 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:42.424978 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:42.424980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:42.424980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:42.424984 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:42.424997 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:42.425001 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:42.425054 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:42.425120 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 22:58:42.425128 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:58:42.436160 20968 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:42.436836 20968 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:42.440474 20968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da412c556c534f7797dbf24222cd5cbc: Generated new TSK 0
I20260929 22:58:42.440618 20968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:42.443235 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 20888
W20260929 22:58:42.447415 20873 connection.cc:535] client connection to 127.0.0.1:39215 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39215): Connection reset by peer (error 104)
2026-09-29T22:58:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1281 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:42 dist-test-slave-512q krb5kdc[20987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:42 dist-test-slave-512q krb5kdc[20987](info): set up 2 sockets
Sep 29 22:58:42 dist-test-slave-512q krb5kdc[20987](info): commencing operation
krb5kdc: starting...
W20260929 22:58:43.466650 498 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:43 dist-test-slave-512q krb5kdc[20987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:43.578207 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:43.656950 21000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:43.657147 21000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:43.657171 21000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:43.658311 21000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:43.658358 21000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:43.658375 21000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:43.658438 21000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:43.658469 21000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:43.659994 21000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:43.660307 21000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:43.660539 21000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:43.665441 21000 server_base.cc:1034] running on GCE node
W20260929 22:58:43.665395 21005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:43.665395 21006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:43.665416 21008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:43.665871 21000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:43.666150 21000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:43.667331 21000 hybrid_clock.cc:648] HybridClock initialized: now 1790722723667306 us; error 35 us; skew 500 ppm
Sep 29 22:58:43 dist-test-slave-512q krb5kdc[20987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722723, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:43.669796 21000 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:43.670238 21000 webserver.cc:460] Webserver started at http://127.0.0.1:44387/ using document root <none> and password file <none>
I20260929 22:58:43.670462 21000 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:43.670538 21000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:43.670680 21000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:43.671676 21000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "db1901a5fbc444a4876409f172ac6f40"
format_stamp: "Formatted at 2026-09-29 22:58:43 on dist-test-slave-512q"
server_key: "915d86fce9c802bd76d724ed021b35d4"
server_key_iv: "76179e7c71618003195000ca12bdabcb"
server_key_version: "encryptionkey@0"
I20260929 22:58:43.672025 21000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "db1901a5fbc444a4876409f172ac6f40"
format_stamp: "Formatted at 2026-09-29 22:58:43 on dist-test-slave-512q"
server_key: "915d86fce9c802bd76d724ed021b35d4"
server_key_iv: "76179e7c71618003195000ca12bdabcb"
server_key_version: "encryptionkey@0"
I20260929 22:58:43.673352 21000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:58:43.674068 21015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:43.674238 21000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:43.674335 21000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "db1901a5fbc444a4876409f172ac6f40"
format_stamp: "Formatted at 2026-09-29 22:58:43 on dist-test-slave-512q"
server_key: "915d86fce9c802bd76d724ed021b35d4"
server_key_iv: "76179e7c71618003195000ca12bdabcb"
server_key_version: "encryptionkey@0"
I20260929 22:58:43.674417 21000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:43.677711 21000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:43.679535 21000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:43.679690 21000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:43.683724 21000 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39785
I20260929 22:58:43.683754 21067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39785 every 8 connection(s)
I20260929 22:58:43.684063 21000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:43.685106 21068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:43.687193 21068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40: Bootstrap starting.
I20260929 22:58:43.687691 21068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:43.687933 21068 log.cc:824] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:43.688580 21068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40: No bootstrap required, opened a new log
I20260929 22:58:43.690052 21068 raft_consensus.cc:348] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } }
I20260929 22:58:43.690215 21068 raft_consensus.cc:374] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:43.690239 21068 raft_consensus.cc:729] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db1901a5fbc444a4876409f172ac6f40, State: Initialized, Role: FOLLOWER
I20260929 22:58:43.690337 21068 consensus_queue.cc:260] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } }
I20260929 22:58:43.690388 21068 raft_consensus.cc:388] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:43.690408 21068 raft_consensus.cc:482] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:43.690433 21068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:43.690896 21068 raft_consensus.cc:504] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } }
I20260929 22:58:43.690974 21068 leader_election.cc:302] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db1901a5fbc444a4876409f172ac6f40; no voters:
I20260929 22:58:43.691083 21068 leader_election.cc:288] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:43.691150 21071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:43.691329 21068 sys_catalog.cc:564] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:43.691488 21071 raft_consensus.cc:686] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [term 1 LEADER]: Becoming Leader. State: Replica: db1901a5fbc444a4876409f172ac6f40, State: Running, Role: LEADER
I20260929 22:58:43.691578 21071 consensus_queue.cc:237] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } }
I20260929 22:58:43.691959 21072 sys_catalog.cc:455] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db1901a5fbc444a4876409f172ac6f40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } } }
I20260929 22:58:43.692056 21072 sys_catalog.cc:458] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:43.692301 21080 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:43.692399 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21000
I20260929 22:58:43.692530 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:43.692764 498 external_mini_cluster.cc:1428] Setting key bb77acd6c3e228975cfd0ec728311ffe
I20260929 22:58:43.692802 21080 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:43.692996 21073 sys_catalog.cc:455] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db1901a5fbc444a4876409f172ac6f40. Latest consensus state: current_term: 1 leader_uuid: "db1901a5fbc444a4876409f172ac6f40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1901a5fbc444a4876409f172ac6f40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39785 } } }
I20260929 22:58:43.693194 21073 sys_catalog.cc:458] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:43.694489 21080 catalog_manager.cc:1347] Generated new cluster ID: cdab0736435d4ebdb21a43b96ee22e70
I20260929 22:58:43.694545 21080 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:43.695024 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:43.693373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43889 (local address 127.0.0.1:39785)
0929 22:58:43.693604 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:43.693613 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:43.693640 (+ 27us) server_negotiation.cc:407] Connection header received
0929 22:58:43.693742 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:43.693749 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:43.693778 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:43.693908 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:43.694550 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:43.694554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:43.694554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:43.694559 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:43.694602 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:43.694616 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:43.694679 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:43.694757 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 22:58:43.694877 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":72,"threads_started":1}
I20260929 22:58:43.695811 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:43.698235 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:43.697195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35713 (local address 127.0.0.1:39785)
0929 22:58:43.697229 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:43.697231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:43.697350 (+ 119us) server_negotiation.cc:407] Connection header received
0929 22:58:43.697415 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:43.697416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:43.697437 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:43.697479 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:43.698017 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:43.698018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:43.698019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:43.698023 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:43.698035 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:43.698039 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:43.698095 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:43.698146 (+ 51us) server_negotiation.cc:299] Negotiation successful
0929 22:58:43.698160 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:58:43.701081 21080 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:43.701231 21080 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:43.712365 21080 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db1901a5fbc444a4876409f172ac6f40: Generated new TSK 0
I20260929 22:58:43.712535 21080 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:43.713948 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21000
2026-09-29T22:58:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1270 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:43 dist-test-slave-512q krb5kdc[21099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:43 dist-test-slave-512q krb5kdc[21099](info): set up 2 sockets
Sep 29 22:58:43 dist-test-slave-512q krb5kdc[21099](info): commencing operation
krb5kdc: starting...
W20260929 22:58:44.738173 498 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:44 dist-test-slave-512q krb5kdc[21099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:44.851279 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:44.929852 21112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:44.930043 21112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:44.930066 21112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:44.931180 21112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:44.931216 21112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:44.931231 21112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:44.931243 21112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:44.931255 21112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:44.932655 21112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:44.932823 21112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:44.932979 21112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:44.937494 21120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:44.937554 21118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:44.937502 21117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:44.937659 21112 server_base.cc:1034] running on GCE node
I20260929 22:58:44.937915 21112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:44.938222 21112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:44.939386 21112 hybrid_clock.cc:648] HybridClock initialized: now 1790722724939356 us; error 42 us; skew 500 ppm
Sep 29 22:58:44 dist-test-slave-512q krb5kdc[21099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722724, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:44.941730 21112 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:44.942184 21112 webserver.cc:460] Webserver started at http://127.0.0.1:45259/ using document root <none> and password file <none>
I20260929 22:58:44.942394 21112 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:44.942464 21112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:44.942637 21112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:44.943598 21112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "e73f3ee851cd4f45a789feea4f4404bd"
format_stamp: "Formatted at 2026-09-29 22:58:44 on dist-test-slave-512q"
server_key: "1b8ff605bc4bb7a1f41ed882e8cfba77"
server_key_iv: "f5a8ecdfe39c4773ae8f021fa5aacf7c"
server_key_version: "encryptionkey@0"
I20260929 22:58:44.943944 21112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "e73f3ee851cd4f45a789feea4f4404bd"
format_stamp: "Formatted at 2026-09-29 22:58:44 on dist-test-slave-512q"
server_key: "1b8ff605bc4bb7a1f41ed882e8cfba77"
server_key_iv: "f5a8ecdfe39c4773ae8f021fa5aacf7c"
server_key_version: "encryptionkey@0"
I20260929 22:58:44.945295 21112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:58:44.946045 21127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:44.946230 21112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:44.946326 21112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "e73f3ee851cd4f45a789feea4f4404bd"
format_stamp: "Formatted at 2026-09-29 22:58:44 on dist-test-slave-512q"
server_key: "1b8ff605bc4bb7a1f41ed882e8cfba77"
server_key_iv: "f5a8ecdfe39c4773ae8f021fa5aacf7c"
server_key_version: "encryptionkey@0"
I20260929 22:58:44.946409 21112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:44.956625 21112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:44.958499 21112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:44.958657 21112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:44.962738 21112 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36251
I20260929 22:58:44.962795 21179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36251 every 8 connection(s)
I20260929 22:58:44.963129 21112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:44.963979 21180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:44.965144 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21112
I20260929 22:58:44.965279 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:44.965493 498 external_mini_cluster.cc:1428] Setting key 31a5dc2f96619d8bde34f2a8c2e5905d
I20260929 22:58:44.967732 21180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd: Bootstrap starting.
I20260929 22:58:44.968452 21180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:44.968832 21180 log.cc:824] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:44.969609 21180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd: No bootstrap required, opened a new log
I20260929 22:58:44.972506 21180 raft_consensus.cc:348] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } }
I20260929 22:58:44.972664 21180 raft_consensus.cc:374] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:44.972692 21180 raft_consensus.cc:729] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73f3ee851cd4f45a789feea4f4404bd, State: Initialized, Role: FOLLOWER
Sep 29 22:58:44 dist-test-slave-512q krb5kdc[21099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:58:44.972868 21180 consensus_queue.cc:260] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } }
I20260929 22:58:44.972963 21180 raft_consensus.cc:388] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:44.973003 21180 raft_consensus.cc:482] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:44.973067 21180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:44.973840 21180 raft_consensus.cc:504] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } }
I20260929 22:58:44.974002 21180 leader_election.cc:302] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e73f3ee851cd4f45a789feea4f4404bd; no voters:
I20260929 22:58:44.974232 21180 leader_election.cc:288] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:44.974293 21185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:44.974455 21185 raft_consensus.cc:686] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [term 1 LEADER]: Becoming Leader. State: Replica: e73f3ee851cd4f45a789feea4f4404bd, State: Running, Role: LEADER
I20260929 22:58:44.974560 21180 sys_catalog.cc:564] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:44.974594 21185 consensus_queue.cc:237] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } }
I20260929 22:58:44.974943 21185 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e73f3ee851cd4f45a789feea4f4404bd. Latest consensus state: current_term: 1 leader_uuid: "e73f3ee851cd4f45a789feea4f4404bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } } }
I20260929 22:58:44.975015 21185 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:44.975165 21186 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e73f3ee851cd4f45a789feea4f4404bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73f3ee851cd4f45a789feea4f4404bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36251 } } }
I20260929 22:58:44.975232 21186 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:44.975354 21191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:44.975860 21191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:44.977368 21191 catalog_manager.cc:1347] Generated new cluster ID: 40331b85cb2d47e3b5a2bba56466e7a9
I20260929 22:58:44.977425 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:44.966016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33331 (local address 127.0.0.1:36251)
0929 22:58:44.966187 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:44.966195 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:44.966218 (+ 23us) server_negotiation.cc:407] Connection header received
0929 22:58:44.966579 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:44.966585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:44.966626 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:44.966734 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:44.967686 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:44.968674 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:44.969807 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:44.970228 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:44.970312 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:44.973361 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:44.973364 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:44.973365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:44.973374 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:44.975421 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:44.975884 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:44.975887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:44.975888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:44.976025 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:44.976408 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:44.976409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:44.976410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:44.976757 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:44.976940 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:44.977061 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 22:58:44.977208 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260929 22:58:44.977438 21191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:44.978436 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:44.987910 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:44.979943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42889 (local address 127.0.0.1:36251)
0929 22:58:44.979975 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:44.979977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:44.980418 (+ 441us) server_negotiation.cc:407] Connection header received
0929 22:58:44.980488 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:44.980489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:44.980500 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:44.980563 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:44.981237 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:44.982049 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:44.983160 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:44.983485 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:44.983558 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:44.985026 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:44.985027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:44.985028 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:44.985035 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:44.986689 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:44.987089 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:44.987090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:44.987090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:44.987178 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:44.987409 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:44.987410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:44.987410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:44.987531 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:44.987626 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:44.987755 (+ 129us) server_negotiation.cc:299] Negotiation successful
0929 22:58:44.987824 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":17}
I20260929 22:58:44.990646 21191 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:44.991297 21191 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:45.012398 21191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e73f3ee851cd4f45a789feea4f4404bd: Generated new TSK 0
I20260929 22:58:45.012609 21191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:45.016870 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21112
2026-09-29T22:58:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1303 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:45 dist-test-slave-512q krb5kdc[21211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:45 dist-test-slave-512q krb5kdc[21211](info): set up 2 sockets
Sep 29 22:58:45 dist-test-slave-512q krb5kdc[21211](info): commencing operation
krb5kdc: starting...
W20260929 22:58:46.054451 498 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:46 dist-test-slave-512q krb5kdc[21211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:46.164851 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34543
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:46.242075 21224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:46.242267 21224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:46.242290 21224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:46.243348 21224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:46.243383 21224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:46.243398 21224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:46.243410 21224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:46.243423 21224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:46.244822 21224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:46.244982 21224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:46.245141 21224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:46.249889 21224 server_base.cc:1034] running on GCE node
W20260929 22:58:46.249852 21230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:46.249855 21232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:46.250092 21229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:46.250433 21224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:46.250684 21224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:46.251885 21224 hybrid_clock.cc:648] HybridClock initialized: now 1790722726251868 us; error 43 us; skew 500 ppm
Sep 29 22:58:46 dist-test-slave-512q krb5kdc[21211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722726, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:46.258831 21224 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:46.259238 21224 webserver.cc:460] Webserver started at http://127.0.0.1:42625/ using document root <none> and password file <none>
I20260929 22:58:46.259469 21224 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:46.259541 21224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:46.259680 21224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:46.260731 21224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "4036911c6c094fff91d443006882813a"
format_stamp: "Formatted at 2026-09-29 22:58:46 on dist-test-slave-512q"
server_key: "713cdfedea7198efcc0db69fcf2616b2"
server_key_iv: "4a38fb42c3d09c2549a681ddbb52cb4b"
server_key_version: "encryptionkey@0"
I20260929 22:58:46.261092 21224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "4036911c6c094fff91d443006882813a"
format_stamp: "Formatted at 2026-09-29 22:58:46 on dist-test-slave-512q"
server_key: "713cdfedea7198efcc0db69fcf2616b2"
server_key_iv: "4a38fb42c3d09c2549a681ddbb52cb4b"
server_key_version: "encryptionkey@0"
I20260929 22:58:46.262359 21224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:58:46.263057 21239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:46.263221 21224 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:46.263320 21224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "4036911c6c094fff91d443006882813a"
format_stamp: "Formatted at 2026-09-29 22:58:46 on dist-test-slave-512q"
server_key: "713cdfedea7198efcc0db69fcf2616b2"
server_key_iv: "4a38fb42c3d09c2549a681ddbb52cb4b"
server_key_version: "encryptionkey@0"
I20260929 22:58:46.263388 21224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:46.280121 21224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:46.281855 21224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:46.282004 21224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:46.285636 21224 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34543
I20260929 22:58:46.285674 21291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34543 every 8 connection(s)
I20260929 22:58:46.286010 21224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:46.286816 21292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:46.288810 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21224
I20260929 22:58:46.288916 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:46.289112 498 external_mini_cluster.cc:1428] Setting key 5b16f5c7c05bb2c5e6279cb5e50c3c98
I20260929 22:58:46.289119 21292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a: Bootstrap starting.
I20260929 22:58:46.289901 21292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:46.290251 21292 log.cc:824] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:46.290962 21292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a: No bootstrap required, opened a new log
I20260929 22:58:46.293246 21292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260929 22:58:46.293406 21292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:46.293438 21292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4036911c6c094fff91d443006882813a, State: Initialized, Role: FOLLOWER
I20260929 22:58:46.293560 21292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260929 22:58:46.293628 21292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:46.293670 21292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:46.293725 21292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:46.294472 21292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260929 22:58:46.294589 21292 leader_election.cc:302] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4036911c6c094fff91d443006882813a; no voters:
I20260929 22:58:46.294754 21292 leader_election.cc:288] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:46.294790 21297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:46.295012 21292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:46.295102 21297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [term 1 LEADER]: Becoming Leader. State: Replica: 4036911c6c094fff91d443006882813a, State: Running, Role: LEADER
I20260929 22:58:46.295241 21297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260929 22:58:46.295280 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:46.289634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54703 (local address 127.0.0.1:34543)
0929 22:58:46.289840 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:46.289849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:46.289883 (+ 34us) server_negotiation.cc:407] Connection header received
0929 22:58:46.290527 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:46.290535 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:46.290580 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:46.290744 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:46.290909 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:46.292321 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:46.293051 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:46.293668 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:46.293778 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:46.294425 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:46.294429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:46.294430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:46.294632 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:46.294670 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:46.294685 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:46.294759 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:46.294949 (+ 190us) server_negotiation.cc:299] Negotiation successful
0929 22:58:46.295038 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":86,"threads_started":1}
I20260929 22:58:46.295591 21297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4036911c6c094fff91d443006882813a. Latest consensus state: current_term: 1 leader_uuid: "4036911c6c094fff91d443006882813a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } } }
I20260929 22:58:46.295663 21297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:46.295939 21298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4036911c6c094fff91d443006882813a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4036911c6c094fff91d443006882813a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } } }
I20260929 22:58:46.296025 21306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:46.296085 21298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:46.296157 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:46.296569 21306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:46.298462 21306 catalog_manager.cc:1347] Generated new cluster ID: b726f3f4104e4c43aa22f5b09a6217d6
I20260929 22:58:46.298525 21306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:46.301285 21295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:46.297888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45095 (local address 127.0.0.1:34543)
0929 22:58:46.297929 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:46.297931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:46.298000 (+ 69us) server_negotiation.cc:407] Connection header received
0929 22:58:46.298062 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:46.298063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:46.298074 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:46.298127 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:46.298278 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:46.299015 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:46.299991 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:46.300318 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:46.300395 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:46.301052 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:46.301053 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:46.301054 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:46.301058 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:46.301073 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:46.301077 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:46.301143 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:46.301192 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 22:58:46.301214 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:58:46.313802 21306 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:46.314289 21306 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:46.321625 21306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4036911c6c094fff91d443006882813a: Generated new TSK 0
I20260929 22:58:46.321786 21306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:46.327188 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21224
2026-09-29T22:58:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1309 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:46 dist-test-slave-512q krb5kdc[21323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:46 dist-test-slave-512q krb5kdc[21323](info): set up 2 sockets
Sep 29 22:58:46 dist-test-slave-512q krb5kdc[21323](info): commencing operation
krb5kdc: starting...
W20260929 22:58:47.354671 498 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:47 dist-test-slave-512q krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:47.466387 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:47.546177 21336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:47.546361 21336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:47.546382 21336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:47.548056 21336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:47.548098 21336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:47.548112 21336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:47.548125 21336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:47.548168 21336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:47.549643 21336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:47.549878 21336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:47.550097 21336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:47.554963 21336 server_base.cc:1034] running on GCE node
W20260929 22:58:47.554975 21344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:47.554982 21341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:47.555085 21342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:47.555454 21336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:47.555680 21336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:47.556814 21336 hybrid_clock.cc:648] HybridClock initialized: now 1790722727556800 us; error 28 us; skew 500 ppm
Sep 29 22:58:47 dist-test-slave-512q krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722727, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:47.559171 21336 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:47.559585 21336 webserver.cc:460] Webserver started at http://127.0.0.1:43503/ using document root <none> and password file <none>
I20260929 22:58:47.559767 21336 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:47.559824 21336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:47.559906 21336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:47.560920 21336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "bede3479adb74dee9ae30430cf3970df"
format_stamp: "Formatted at 2026-09-29 22:58:47 on dist-test-slave-512q"
server_key: "c178c832592a1431dfb9c9a0c60988d0"
server_key_iv: "f7ca71732999678b4f19b5eb26135151"
server_key_version: "encryptionkey@0"
I20260929 22:58:47.561213 21336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "bede3479adb74dee9ae30430cf3970df"
format_stamp: "Formatted at 2026-09-29 22:58:47 on dist-test-slave-512q"
server_key: "c178c832592a1431dfb9c9a0c60988d0"
server_key_iv: "f7ca71732999678b4f19b5eb26135151"
server_key_version: "encryptionkey@0"
I20260929 22:58:47.562386 21336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:47.562989 21351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:47.563203 21336 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:47.563297 21336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "bede3479adb74dee9ae30430cf3970df"
format_stamp: "Formatted at 2026-09-29 22:58:47 on dist-test-slave-512q"
server_key: "c178c832592a1431dfb9c9a0c60988d0"
server_key_iv: "f7ca71732999678b4f19b5eb26135151"
server_key_version: "encryptionkey@0"
I20260929 22:58:47.563372 21336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:47.566568 21336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:47.568334 21336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:47.568475 21336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:47.572345 21336 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45859
I20260929 22:58:47.572398 21403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45859 every 8 connection(s)
I20260929 22:58:47.572690 21336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:47.573566 21404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:47.575609 21404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df: Bootstrap starting.
I20260929 22:58:47.576144 21404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:47.576448 21404 log.cc:824] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:47.577088 21404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df: No bootstrap required, opened a new log
I20260929 22:58:47.578629 21404 raft_consensus.cc:348] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260929 22:58:47.578753 21404 raft_consensus.cc:374] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:47.578774 21404 raft_consensus.cc:729] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bede3479adb74dee9ae30430cf3970df, State: Initialized, Role: FOLLOWER
I20260929 22:58:47.578954 21404 consensus_queue.cc:260] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260929 22:58:47.579015 21404 raft_consensus.cc:388] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:47.579070 21404 raft_consensus.cc:482] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:47.579118 21404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:47.579629 21404 raft_consensus.cc:504] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260929 22:58:47.579735 21404 leader_election.cc:302] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bede3479adb74dee9ae30430cf3970df; no voters:
I20260929 22:58:47.579905 21404 leader_election.cc:288] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:47.579972 21407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:47.580142 21407 raft_consensus.cc:686] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [term 1 LEADER]: Becoming Leader. State: Replica: bede3479adb74dee9ae30430cf3970df, State: Running, Role: LEADER
I20260929 22:58:47.580165 21404 sys_catalog.cc:564] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:47.580252 21407 consensus_queue.cc:237] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260929 22:58:47.580492 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21336
I20260929 22:58:47.580622 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:47.580811 498 external_mini_cluster.cc:1428] Setting key eb52e21873003e1bf593e38aec23a2fa
I20260929 22:58:47.581363 21408 sys_catalog.cc:455] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bede3479adb74dee9ae30430cf3970df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } } }
I20260929 22:58:47.581422 21409 sys_catalog.cc:455] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [sys.catalog]: SysCatalogTable state changed. Reason: New leader bede3479adb74dee9ae30430cf3970df. Latest consensus state: current_term: 1 leader_uuid: "bede3479adb74dee9ae30430cf3970df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bede3479adb74dee9ae30430cf3970df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } } }
I20260929 22:58:47.581462 21408 sys_catalog.cc:458] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:47.581475 21409 sys_catalog.cc:458] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:47.581708 21420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:47.582186 21420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:47.583691 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:47.581233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49851 (local address 127.0.0.1:45859)
0929 22:58:47.581401 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:47.581409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:47.581708 (+ 299us) server_negotiation.cc:407] Connection header received
0929 22:58:47.581918 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:47.581926 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:47.581960 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:47.582068 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:47.583221 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:47.583224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:47.583225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:47.583230 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:47.583279 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:47.583297 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:47.583361 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:47.583452 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 22:58:47.583493 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260929 22:58:47.583775 21420 catalog_manager.cc:1347] Generated new cluster ID: 98f6f96a151d49bb999ca2d756411f02
I20260929 22:58:47.583809 21420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:47.584645 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:47.587136 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:47.586187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41583 (local address 127.0.0.1:45859)
0929 22:58:47.586214 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:47.586216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:47.586229 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:58:47.586308 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:47.586309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:47.586313 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:47.586350 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:47.586911 (+ 561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:47.586912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:47.586912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:47.586916 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:47.586928 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:47.586932 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:47.586983 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:47.587057 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:58:47.587068 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260929 22:58:47.605964 21420 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:47.606165 21420 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:47.609449 21420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bede3479adb74dee9ae30430cf3970df: Generated new TSK 0
I20260929 22:58:47.609642 21420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:47.617774 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21336
2026-09-29T22:58:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1290 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:47 dist-test-slave-512q krb5kdc[21435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:47 dist-test-slave-512q krb5kdc[21435](info): set up 2 sockets
Sep 29 22:58:47 dist-test-slave-512q krb5kdc[21435](info): commencing operation
krb5kdc: starting...
W20260929 22:58:48.650257 498 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:48.764676 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36757
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:48.844794 21448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:48.844992 21448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:48.845014 21448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:48.846135 21448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:48.846177 21448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:48.846191 21448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:48.846238 21448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:48.846256 21448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:48.847730 21448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:48.847978 21448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:48.848203 21448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:48.853084 21453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:48.853075 21454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:48.853307 21448 server_base.cc:1034] running on GCE node
W20260929 22:58:48.853384 21456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:48.853605 21448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:48.853826 21448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:48.854964 21448 hybrid_clock.cc:648] HybridClock initialized: now 1790722728854948 us; error 30 us; skew 500 ppm
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722728, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:48.857524 21448 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:48.857928 21448 webserver.cc:460] Webserver started at http://127.0.0.1:38753/ using document root <none> and password file <none>
I20260929 22:58:48.858176 21448 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:48.858245 21448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:48.858392 21448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:48.859414 21448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "970a847484164b1b9ca176b1423b25d8"
format_stamp: "Formatted at 2026-09-29 22:58:48 on dist-test-slave-512q"
server_key: "0dea481ed0bcb05f165fcae62f4d2b2f"
server_key_iv: "eef6abb1901aa787bffbe9005bdbec1b"
server_key_version: "encryptionkey@0"
I20260929 22:58:48.859764 21448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "970a847484164b1b9ca176b1423b25d8"
format_stamp: "Formatted at 2026-09-29 22:58:48 on dist-test-slave-512q"
server_key: "0dea481ed0bcb05f165fcae62f4d2b2f"
server_key_iv: "eef6abb1901aa787bffbe9005bdbec1b"
server_key_version: "encryptionkey@0"
I20260929 22:58:48.861126 21448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:58:48.861799 21463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:48.861961 21448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:48.862072 21448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "970a847484164b1b9ca176b1423b25d8"
format_stamp: "Formatted at 2026-09-29 22:58:48 on dist-test-slave-512q"
server_key: "0dea481ed0bcb05f165fcae62f4d2b2f"
server_key_iv: "eef6abb1901aa787bffbe9005bdbec1b"
server_key_version: "encryptionkey@0"
I20260929 22:58:48.862145 21448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:48.875849 21448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:48.878100 21448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:48.878254 21448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:48.882015 21448 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36757
I20260929 22:58:48.882046 21515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36757 every 8 connection(s)
I20260929 22:58:48.882375 21448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:48.883167 21516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:48.885327 21516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: Bootstrap starting.
I20260929 22:58:48.885893 21516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:48.886173 21516 log.cc:824] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:48.886840 21516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: No bootstrap required, opened a new log
I20260929 22:58:48.888466 21516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } }
I20260929 22:58:48.888599 21516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:48.888621 21516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970a847484164b1b9ca176b1423b25d8, State: Initialized, Role: FOLLOWER
I20260929 22:58:48.888803 21516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } }
I20260929 22:58:48.888867 21516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:48.888906 21516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:48.888957 21516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:48.889375 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21448
I20260929 22:58:48.889493 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:48.889506 21516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } }
I20260929 22:58:48.889642 21516 leader_election.cc:302] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 970a847484164b1b9ca176b1423b25d8; no voters:
I20260929 22:58:48.889681 498 external_mini_cluster.cc:1428] Setting key 27c06234fa969a753c75e0cc05670105
I20260929 22:58:48.889813 21516 leader_election.cc:288] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:48.889842 21519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:48.890030 21519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [term 1 LEADER]: Becoming Leader. State: Replica: 970a847484164b1b9ca176b1423b25d8, State: Running, Role: LEADER
I20260929 22:58:48.890128 21516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:48.890178 21519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } }
I20260929 22:58:48.890836 21521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 970a847484164b1b9ca176b1423b25d8. Latest consensus state: current_term: 1 leader_uuid: "970a847484164b1b9ca176b1423b25d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } } }
I20260929 22:58:48.890921 21521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:48.891403 21520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "970a847484164b1b9ca176b1423b25d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970a847484164b1b9ca176b1423b25d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36757 } } }
I20260929 22:58:48.891479 21520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8 [sys.catalog]: This master's current role is: LEADER
W20260929 22:58:48.892522 21537 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:58:48.892590 21537 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:58:48.892673 21525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:48.892848 21525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:48.895160 21525 catalog_manager.cc:1347] Generated new cluster ID: f9872eb93c4d46d2af269a2ddf2ca542
I20260929 22:58:48.895217 21525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:58:48.901629 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:48.890280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:37827 (local address 127.0.0.1:36757)
0929 22:58:48.890416 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:48.890425 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:48.890456 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:58:48.890569 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:48.890576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:48.890636 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:48.891588 (+ 952us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:48.891691 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:48.892966 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:48.893897 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:48.894494 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:48.894604 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:48.897387 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:48.897391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:48.897391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:48.897403 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:48.899924 (+ 2521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:48.900403 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:48.900406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:48.900407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:48.900521 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:48.900765 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:48.900765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:48.900766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:48.901045 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:48.901195 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:48.901334 (+ 139us) server_negotiation.cc:299] Negotiation successful
0929 22:58:48.901430 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":67,"threads_started":1}
I20260929 22:58:48.902549 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:48.911019 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:48.903966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:55569 (local address 127.0.0.1:36757)
0929 22:58:48.904024 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:48.904025 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:48.904150 (+ 125us) server_negotiation.cc:407] Connection header received
0929 22:58:48.904193 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:48.904194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:48.904203 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:48.904260 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:48.904873 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:48.905607 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:48.906675 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:48.906970 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:48.907027 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:48.908369 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:48.908370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:48.908370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:48.908377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:48.909820 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:48.910247 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:48.910248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:48.910248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:48.910298 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:48.910522 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:48.910523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:48.910523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:48.910637 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:48.910724 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:48.910882 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:58:48.910938 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:58:48.928093 21525 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:48.928771 21525 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:48.931650 21525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 970a847484164b1b9ca176b1423b25d8: Generated new TSK 0
I20260929 22:58:48.931809 21525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:48.938515 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21448
W20260929 22:58:48.942662 21433 connection.cc:535] client connection to 127.0.0.1:36757 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36757): Connection reset by peer (error 104)
2026-09-29T22:58:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1320 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21547](info): set up 2 sockets
Sep 29 22:58:48 dist-test-slave-512q krb5kdc[21547](info): commencing operation
krb5kdc: starting...
W20260929 22:58:49.958611 498 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:50 dist-test-slave-512q krb5kdc[21547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:50.071831 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46491
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:50.149968 21560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:50.150213 21560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:50.150235 21560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:50.151314 21560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:50.151348 21560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:50.151362 21560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:50.151374 21560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:50.151386 21560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:50.152765 21560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:50.152941 21560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:50.153105 21560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:50.157799 21565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:50.157822 21568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:50.157855 21566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:50.157917 21560 server_base.cc:1034] running on GCE node
I20260929 22:58:50.158286 21560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:50.158602 21560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:50.159770 21560 hybrid_clock.cc:648] HybridClock initialized: now 1790722730159765 us; error 37 us; skew 500 ppm
Sep 29 22:58:50 dist-test-slave-512q krb5kdc[21547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722730, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:50.162206 21560 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:50.162652 21560 webserver.cc:460] Webserver started at http://127.0.0.1:44719/ using document root <none> and password file <none>
I20260929 22:58:50.162866 21560 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:50.162930 21560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:50.163082 21560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:50.164101 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "3ba4534272c74a49904af62a1fabcab5"
format_stamp: "Formatted at 2026-09-29 22:58:50 on dist-test-slave-512q"
server_key: "3360d8aedd054ab769615f55d099a2aa"
server_key_iv: "ed1c338bfc9156ecfc993c4fd6f887ca"
server_key_version: "encryptionkey@0"
I20260929 22:58:50.164529 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "3ba4534272c74a49904af62a1fabcab5"
format_stamp: "Formatted at 2026-09-29 22:58:50 on dist-test-slave-512q"
server_key: "3360d8aedd054ab769615f55d099a2aa"
server_key_iv: "ed1c338bfc9156ecfc993c4fd6f887ca"
server_key_version: "encryptionkey@0"
I20260929 22:58:50.165794 21560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:50.166461 21575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:50.166621 21560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:50.166716 21560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "3ba4534272c74a49904af62a1fabcab5"
format_stamp: "Formatted at 2026-09-29 22:58:50 on dist-test-slave-512q"
server_key: "3360d8aedd054ab769615f55d099a2aa"
server_key_iv: "ed1c338bfc9156ecfc993c4fd6f887ca"
server_key_version: "encryptionkey@0"
I20260929 22:58:50.166800 21560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:50.184871 21560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:50.187034 21560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:50.187186 21560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:50.191027 21560 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46491
I20260929 22:58:50.191051 21627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46491 every 8 connection(s)
I20260929 22:58:50.191381 21560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:50.192180 21628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:50.194396 21628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5: Bootstrap starting.
I20260929 22:58:50.194914 21628 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:50.195129 21628 log.cc:824] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:50.195776 21628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5: No bootstrap required, opened a new log
I20260929 22:58:50.195917 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21560
I20260929 22:58:50.196043 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:50.196240 498 external_mini_cluster.cc:1428] Setting key 194af284f72f609d434b757ffab38880
I20260929 22:58:50.197783 21628 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } }
I20260929 22:58:50.197947 21628 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:50.197983 21628 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba4534272c74a49904af62a1fabcab5, State: Initialized, Role: FOLLOWER
I20260929 22:58:50.198155 21628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } }
I20260929 22:58:50.198249 21628 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:50.198272 21628 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:50.198351 21628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:50.198839 21628 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } }
I20260929 22:58:50.198918 21628 leader_election.cc:302] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ba4534272c74a49904af62a1fabcab5; no voters:
I20260929 22:58:50.199087 21628 leader_election.cc:288] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:50.199117 21633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:50.199218 21633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba4534272c74a49904af62a1fabcab5, State: Running, Role: LEADER
I20260929 22:58:50.199337 21628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:50.199347 21633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } }
I20260929 22:58:50.199736 21633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ba4534272c74a49904af62a1fabcab5. Latest consensus state: current_term: 1 leader_uuid: "3ba4534272c74a49904af62a1fabcab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } } }
I20260929 22:58:50.199857 21633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:50.200059 21642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:50.200536 21642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:50.201155 21634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ba4534272c74a49904af62a1fabcab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba4534272c74a49904af62a1fabcab5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46491 } } }
I20260929 22:58:50.201279 21634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:50.202809 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:50.196752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:49783 (local address 127.0.0.1:46491)
0929 22:58:50.196930 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:50.196938 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:50.196960 (+ 22us) server_negotiation.cc:407] Connection header received
0929 22:58:50.197749 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:50.197755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:50.197818 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:50.197926 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:50.198189 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:50.199660 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:50.200776 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:50.201337 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:50.201433 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:50.202196 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:50.202200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:50.202200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:50.202375 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:50.202403 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:50.202414 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:50.202482 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:50.202628 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:58:50.202657 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260929 22:58:50.203461 21642 catalog_manager.cc:1347] Generated new cluster ID: 26a3b457544d47b2bc6126f99c025334
I20260929 22:58:50.203526 21642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:50.203879 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:50.208695 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:50.205284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:49897 (local address 127.0.0.1:46491)
0929 22:58:50.205316 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:50.205318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:50.205480 (+ 162us) server_negotiation.cc:407] Connection header received
0929 22:58:50.205506 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:50.205506 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:50.205517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:50.205583 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:50.205697 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:50.206402 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:50.207353 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:50.207683 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:50.207754 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:50.208433 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:50.208435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:50.208435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:50.208441 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:50.208458 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:50.208464 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:50.208535 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:50.208605 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:58:50.208617 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:58:50.215544 21642 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:50.216018 21642 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:50.220698 21642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ba4534272c74a49904af62a1fabcab5: Generated new TSK 0
I20260929 22:58:50.220846 21642 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:50.231035 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21560
W20260929 22:58:50.235540 21545 connection.cc:535] client connection to 127.0.0.1:46491 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46491): Connection reset by peer (error 104)
2026-09-29T22:58:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:50 dist-test-slave-512q krb5kdc[21659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:50 dist-test-slave-512q krb5kdc[21659](info): set up 2 sockets
Sep 29 22:58:50 dist-test-slave-512q krb5kdc[21659](info): commencing operation
krb5kdc: starting...
W20260929 22:58:51.254434 498 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:51 dist-test-slave-512q krb5kdc[21659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:51.366766 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34425
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:51.444777 21672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:51.444958 21672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:51.444979 21672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:51.446044 21672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:51.446076 21672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:51.446089 21672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:51.446102 21672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:51.446115 21672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:51.447422 21672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:51.447631 21672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:51.447784 21672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:51.452585 21672 server_base.cc:1034] running on GCE node
W20260929 22:58:51.452469 21678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:51.452469 21680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:51.452490 21677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:51.452943 21672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:51.453207 21672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:51.454367 21672 hybrid_clock.cc:648] HybridClock initialized: now 1790722731454363 us; error 36 us; skew 500 ppm
Sep 29 22:58:51 dist-test-slave-512q krb5kdc[21659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722731, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:51.460456 21672 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:51.460927 21672 webserver.cc:460] Webserver started at http://127.0.0.1:38201/ using document root <none> and password file <none>
I20260929 22:58:51.461143 21672 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:51.461208 21672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:51.461359 21672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:51.462383 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "f69342a31edb4b76abbc679fcbcdafde"
format_stamp: "Formatted at 2026-09-29 22:58:51 on dist-test-slave-512q"
server_key: "de7e17c0199b06852149e178b5d0eb9c"
server_key_iv: "d0252c50fb5356f99920f3ec1f5a36d8"
server_key_version: "encryptionkey@0"
I20260929 22:58:51.462682 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "f69342a31edb4b76abbc679fcbcdafde"
format_stamp: "Formatted at 2026-09-29 22:58:51 on dist-test-slave-512q"
server_key: "de7e17c0199b06852149e178b5d0eb9c"
server_key_iv: "d0252c50fb5356f99920f3ec1f5a36d8"
server_key_version: "encryptionkey@0"
I20260929 22:58:51.463886 21672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:51.464598 21687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:51.464797 21672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:51.464902 21672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "f69342a31edb4b76abbc679fcbcdafde"
format_stamp: "Formatted at 2026-09-29 22:58:51 on dist-test-slave-512q"
server_key: "de7e17c0199b06852149e178b5d0eb9c"
server_key_iv: "d0252c50fb5356f99920f3ec1f5a36d8"
server_key_version: "encryptionkey@0"
I20260929 22:58:51.464979 21672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:51.468044 21672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:51.469713 21672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:51.469846 21672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:51.473780 21672 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34425
I20260929 22:58:51.473810 21739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34425 every 8 connection(s)
I20260929 22:58:51.474113 21672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:51.475090 21740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:51.477326 21740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde: Bootstrap starting.
I20260929 22:58:51.477865 21740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:51.478130 21740 log.cc:824] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:51.478818 21740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde: No bootstrap required, opened a new log
I20260929 22:58:51.480487 21740 raft_consensus.cc:348] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } }
I20260929 22:58:51.480647 21740 raft_consensus.cc:374] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:51.480722 21740 raft_consensus.cc:729] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f69342a31edb4b76abbc679fcbcdafde, State: Initialized, Role: FOLLOWER
I20260929 22:58:51.480845 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21672
I20260929 22:58:51.480891 21740 consensus_queue.cc:260] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } }
I20260929 22:58:51.480957 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:51.480983 21740 raft_consensus.cc:388] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:51.481037 21740 raft_consensus.cc:482] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:51.481088 21740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:51.481140 498 external_mini_cluster.cc:1428] Setting key f4543dea33b12caf0b63cb529ffac1b6
I20260929 22:58:51.481796 21740 raft_consensus.cc:504] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } }
I20260929 22:58:51.481920 21740 leader_election.cc:302] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f69342a31edb4b76abbc679fcbcdafde; no voters:
I20260929 22:58:51.482112 21740 leader_election.cc:288] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:51.482127 21744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:51.482314 21744 raft_consensus.cc:686] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [term 1 LEADER]: Becoming Leader. State: Replica: f69342a31edb4b76abbc679fcbcdafde, State: Running, Role: LEADER
I20260929 22:58:51.482419 21740 sys_catalog.cc:564] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:51.482451 21744 consensus_queue.cc:237] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } }
I20260929 22:58:51.482862 21746 sys_catalog.cc:455] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f69342a31edb4b76abbc679fcbcdafde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } } }
I20260929 22:58:51.482942 21746 sys_catalog.cc:458] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:51.483129 21747 sys_catalog.cc:455] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [sys.catalog]: SysCatalogTable state changed. Reason: New leader f69342a31edb4b76abbc679fcbcdafde. Latest consensus state: current_term: 1 leader_uuid: "f69342a31edb4b76abbc679fcbcdafde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69342a31edb4b76abbc679fcbcdafde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34425 } } }
I20260929 22:58:51.483259 21747 sys_catalog.cc:458] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:51.483412 21751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:51.483922 21751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:51.484351 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:51.481992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:38671 (local address 127.0.0.1:34425)
0929 22:58:51.482196 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:51.482206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:51.482241 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:58:51.482363 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:51.482369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:51.482398 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:51.482811 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:51.483698 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:51.483701 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:51.483702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:51.483706 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:51.483748 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:51.483762 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:51.484060 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:51.484095 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 22:58:51.484140 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260929 22:58:51.485234 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:51.486567 21751 catalog_manager.cc:1347] Generated new cluster ID: 7877d40d127b44c981a2b438cfb8922e
I20260929 22:58:51.486618 21751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:51.497323 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:51.486770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:50725 (local address 127.0.0.1:34425)
0929 22:58:51.486807 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:51.486827 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:51.496380 (+ 9553us) server_negotiation.cc:407] Connection header received
0929 22:58:51.496459 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:51.496460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:51.496466 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:51.496512 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:51.497107 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:51.497108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:51.497108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:51.497113 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:51.497126 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:51.497130 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:51.497180 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:51.497238 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 22:58:51.497251 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:58:51.510111 21751 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:51.510320 21751 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:51.515017 21751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f69342a31edb4b76abbc679fcbcdafde: Generated new TSK 0
I20260929 22:58:51.515204 21751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:51.519057 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21672
2026-09-29T22:58:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1288 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:51 dist-test-slave-512q krb5kdc[21771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:51 dist-test-slave-512q krb5kdc[21771](info): set up 2 sockets
Sep 29 22:58:51 dist-test-slave-512q krb5kdc[21771](info): commencing operation
krb5kdc: starting...
W20260929 22:58:52.546891 498 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:52.658784 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39769
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:52.736362 21784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:52.736596 21784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:52.736634 21784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:52.737761 21784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:52.737828 21784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:52.737850 21784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:52.737870 21784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:52.737900 21784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:52.739300 21784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39769
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:52.739562 21784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:52.739773 21784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:58:52.744508 21784 server_base.cc:1034] running on GCE node
W20260929 22:58:52.744452 21792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:52.744478 21789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:52.744462 21790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:52.744876 21784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:52.745189 21784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:52.746366 21784 hybrid_clock.cc:648] HybridClock initialized: now 1790722732746339 us; error 39 us; skew 500 ppm
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722732, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:52.748720 21784 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:52.749110 21784 webserver.cc:460] Webserver started at http://127.0.0.1:36499/ using document root <none> and password file <none>
I20260929 22:58:52.749310 21784 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:52.749368 21784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:52.749495 21784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:52.750468 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38"
format_stamp: "Formatted at 2026-09-29 22:58:52 on dist-test-slave-512q"
server_key: "5f4e1e9c4120a96e788e409e9a7f8b24"
server_key_iv: "3f6ad0c93ef86676062127595962ecd7"
server_key_version: "encryptionkey@0"
I20260929 22:58:52.750820 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38"
format_stamp: "Formatted at 2026-09-29 22:58:52 on dist-test-slave-512q"
server_key: "5f4e1e9c4120a96e788e409e9a7f8b24"
server_key_iv: "3f6ad0c93ef86676062127595962ecd7"
server_key_version: "encryptionkey@0"
I20260929 22:58:52.752111 21784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:58:52.752846 21799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:52.753021 21784 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:52.753116 21784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38"
format_stamp: "Formatted at 2026-09-29 22:58:52 on dist-test-slave-512q"
server_key: "5f4e1e9c4120a96e788e409e9a7f8b24"
server_key_iv: "3f6ad0c93ef86676062127595962ecd7"
server_key_version: "encryptionkey@0"
I20260929 22:58:52.753197 21784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:52.766567 21784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:52.768205 21784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:52.768406 21784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:52.771953 21784 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39769
I20260929 22:58:52.771986 21851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39769 every 8 connection(s)
I20260929 22:58:52.772423 21784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:52.772625 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21784
I20260929 22:58:52.772742 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:52.772924 498 external_mini_cluster.cc:1428] Setting key 756434b66b0a834452a46ab4b055a10e
I20260929 22:58:52.773440 21852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:52.776503 21852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: Bootstrap starting.
I20260929 22:58:52.777081 21852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:52.777360 21852 log.cc:824] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:52.777998 21852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: No bootstrap required, opened a new log
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:58:52.780135 21852 raft_consensus.cc:348] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } }
I20260929 22:58:52.780329 21852 raft_consensus.cc:374] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:52.780396 21852 raft_consensus.cc:729] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54a7c70b9df4c4aa7ec78ebedb90e38, State: Initialized, Role: FOLLOWER
I20260929 22:58:52.780550 21852 consensus_queue.cc:260] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } }
I20260929 22:58:52.780669 21852 raft_consensus.cc:388] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:52.780728 21852 raft_consensus.cc:482] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:52.780781 21852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:52.781273 21852 raft_consensus.cc:504] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } }
I20260929 22:58:52.781389 21852 leader_election.cc:302] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e54a7c70b9df4c4aa7ec78ebedb90e38; no voters:
I20260929 22:58:52.781559 21852 leader_election.cc:288] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:52.781591 21857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:52.781709 21857 raft_consensus.cc:686] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [term 1 LEADER]: Becoming Leader. State: Replica: e54a7c70b9df4c4aa7ec78ebedb90e38, State: Running, Role: LEADER
I20260929 22:58:52.781848 21857 consensus_queue.cc:237] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } }
I20260929 22:58:52.781836 21852 sys_catalog.cc:564] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:52.782991 21858 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } } }
I20260929 22:58:52.783084 21858 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:52.783393 21859 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e54a7c70b9df4c4aa7ec78ebedb90e38. Latest consensus state: current_term: 1 leader_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54a7c70b9df4c4aa7ec78ebedb90e38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39769 } } }
I20260929 22:58:52.783546 21859 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38 [sys.catalog]: This master's current role is: LEADER
W20260929 22:58:52.783888 21873 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:58:52.783986 21873 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:58:52.784092 21871 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:52.784266 21871 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:52.784278 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:52.773462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:54643 (local address 127.0.0.1:39769)
0929 22:58:52.773620 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:52.773629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:52.773659 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:58:52.774185 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:52.774193 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:52.774273 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:52.774411 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:52.775116 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:52.776464 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:52.777225 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:52.777660 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:52.777774 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:52.780414 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:52.780419 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:52.780419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:52.780432 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:52.782464 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:52.782906 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:52.782909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:52.782910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:52.783026 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:52.783309 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:52.783310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:52.783310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:52.783633 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:52.783819 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:52.783949 (+ 130us) server_negotiation.cc:299] Negotiation successful
0929 22:58:52.784050 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260929 22:58:52.785351 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:52.788653 21871 catalog_manager.cc:1347] Generated new cluster ID: 8b45e32e6f8a46e496087aa3b802b48d
I20260929 22:58:52.788713 21871 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:52.794056 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:52.786618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:45899 (local address 127.0.0.1:39769)
0929 22:58:52.786655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:52.786657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:52.786762 (+ 105us) server_negotiation.cc:407] Connection header received
0929 22:58:52.786830 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:52.786831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:52.786838 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:52.786879 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:52.787570 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:52.788102 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:52.789274 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:52.789649 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:52.789721 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:52.791116 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:52.791117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:52.791117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:52.791124 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:52.792814 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:52.793235 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:52.793236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:52.793237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:52.793293 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:52.793529 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:52.793529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:52.793530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:52.793646 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:52.793740 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:52.793903 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:58:52.793967 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:58:52.801579 21871 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:52.802307 21871 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:52.806906 21871 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e54a7c70b9df4c4aa7ec78ebedb90e38: Generated new TSK 0
I20260929 22:58:52.807093 21871 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:52.813235 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21784
W20260929 22:58:52.817106 21769 connection.cc:535] client connection to 127.0.0.1:39769 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39769): Connection reset by peer (error 104)
2026-09-29T22:58:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1292 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21883](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21883](info): set up 2 sockets
Sep 29 22:58:52 dist-test-slave-512q krb5kdc[21883](info): commencing operation
krb5kdc: starting...
W20260929 22:58:53.894522 498 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:53 dist-test-slave-512q krb5kdc[21883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:54.006981 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42149
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:54.088284 21896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:54.088506 21896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:54.088554 21896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:54.089694 21896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:54.089762 21896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:54.089787 21896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:54.089819 21896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:54.089844 21896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:54.091360 21896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42149
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:54.091627 21896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:54.091846 21896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:54.096606 21901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:54.096627 21902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:54.096618 21904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:54.096725 21896 server_base.cc:1034] running on GCE node
I20260929 22:58:54.097016 21896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:54.097326 21896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:54.098471 21896 hybrid_clock.cc:648] HybridClock initialized: now 1790722734098450 us; error 35 us; skew 500 ppm
Sep 29 22:58:54 dist-test-slave-512q krb5kdc[21883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722734, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:54.100955 21896 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:54.101411 21896 webserver.cc:460] Webserver started at http://127.0.0.1:45265/ using document root <none> and password file <none>
I20260929 22:58:54.101619 21896 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:54.101660 21896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:54.101787 21896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:54.102784 21896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "c616cfeb2afc4daa92b6bfc410217c65"
format_stamp: "Formatted at 2026-09-29 22:58:54 on dist-test-slave-512q"
server_key: "caede8f368de21c036b7626a31ff456b"
server_key_iv: "17f25b90faee9155be6f97263c11b308"
server_key_version: "encryptionkey@0"
I20260929 22:58:54.103173 21896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "c616cfeb2afc4daa92b6bfc410217c65"
format_stamp: "Formatted at 2026-09-29 22:58:54 on dist-test-slave-512q"
server_key: "caede8f368de21c036b7626a31ff456b"
server_key_iv: "17f25b90faee9155be6f97263c11b308"
server_key_version: "encryptionkey@0"
I20260929 22:58:54.104445 21896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:54.105084 21911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:54.105247 21896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:54.105342 21896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "c616cfeb2afc4daa92b6bfc410217c65"
format_stamp: "Formatted at 2026-09-29 22:58:54 on dist-test-slave-512q"
server_key: "caede8f368de21c036b7626a31ff456b"
server_key_iv: "17f25b90faee9155be6f97263c11b308"
server_key_version: "encryptionkey@0"
I20260929 22:58:54.105410 21896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:54.113850 21896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:54.115996 21896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:54.116150 21896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:54.119647 21896 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42149
I20260929 22:58:54.119712 21963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42149 every 8 connection(s)
I20260929 22:58:54.120018 21896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:54.120922 21964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:54.121578 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 21896
I20260929 22:58:54.121685 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:54.121863 498 external_mini_cluster.cc:1428] Setting key e0c7c2d942f40bea1c9d48401bd56f41
I20260929 22:58:54.123770 21964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65: Bootstrap starting.
I20260929 22:58:54.124405 21964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:54.124711 21964 log.cc:824] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:54.125438 21964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65: No bootstrap required, opened a new log
I20260929 22:58:54.127143 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:54.122399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:36601 (local address 127.0.0.1:42149)
0929 22:58:54.122547 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:54.122556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:54.122585 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:58:54.122965 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:54.122971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:54.123016 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:54.123141 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:54.123375 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:54.124349 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:54.125382 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:54.125807 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:54.125887 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:54.126525 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:54.126529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:54.126529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:54.126686 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:54.126712 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:54.126723 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:54.126788 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:54.126929 (+ 141us) server_negotiation.cc:299] Negotiation successful
0929 22:58:54.126962 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260929 22:58:54.127660 21964 raft_consensus.cc:348] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260929 22:58:54.127854 21964 raft_consensus.cc:374] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:54.127919 21964 raft_consensus.cc:729] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c616cfeb2afc4daa92b6bfc410217c65, State: Initialized, Role: FOLLOWER
I20260929 22:58:54.128065 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:54.128048 21964 consensus_queue.cc:260] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260929 22:58:54.128122 21964 raft_consensus.cc:388] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:54.128161 21964 raft_consensus.cc:482] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:54.128226 21964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:54.128898 21964 raft_consensus.cc:504] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260929 22:58:54.129007 21964 leader_election.cc:302] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c616cfeb2afc4daa92b6bfc410217c65; no voters:
I20260929 22:58:54.129187 21964 leader_election.cc:288] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:54.129350 21974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:54.129429 21964 sys_catalog.cc:564] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:54.129510 21974 raft_consensus.cc:686] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [term 1 LEADER]: Becoming Leader. State: Replica: c616cfeb2afc4daa92b6bfc410217c65, State: Running, Role: LEADER
I20260929 22:58:54.129703 21974 consensus_queue.cc:237] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260929 22:58:54.130105 21974 sys_catalog.cc:455] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c616cfeb2afc4daa92b6bfc410217c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } } }
I20260929 22:58:54.130250 21974 sys_catalog.cc:458] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:54.130411 21974 sys_catalog.cc:455] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c616cfeb2afc4daa92b6bfc410217c65. Latest consensus state: current_term: 1 leader_uuid: "c616cfeb2afc4daa92b6bfc410217c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c616cfeb2afc4daa92b6bfc410217c65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } } }
I20260929 22:58:54.130507 21974 sys_catalog.cc:458] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:54.130918 21983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:54.131418 21983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:54.133103 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:54.129573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:56233 (local address 127.0.0.1:42149)
0929 22:58:54.129626 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:54.129628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:54.129796 (+ 168us) server_negotiation.cc:407] Connection header received
0929 22:58:54.129897 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:54.129898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:54.129909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:54.129970 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:54.130171 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:54.130876 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:54.131872 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:54.132137 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:54.132220 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:54.132873 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:54.132874 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:54.132874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:54.132878 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:54.132891 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:54.132894 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:54.132949 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:54.133025 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 22:58:54.133035 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:58:54.133163 21983 catalog_manager.cc:1347] Generated new cluster ID: f8da6fa2c17e4dbc89c182f6579ad7f8
I20260929 22:58:54.133205 21983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:54.163807 21983 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:54.164458 21983 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:54.169898 21983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c616cfeb2afc4daa92b6bfc410217c65: Generated new TSK 0
I20260929 22:58:54.170101 21983 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:54.178064 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 21896
W20260929 22:58:54.182435 21881 connection.cc:535] client connection to 127.0.0.1:42149 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42149): Connection reset by peer (error 104)
2026-09-29T22:58:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:54 dist-test-slave-512q krb5kdc[21995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:54 dist-test-slave-512q krb5kdc[21995](info): set up 2 sockets
Sep 29 22:58:54 dist-test-slave-512q krb5kdc[21995](info): commencing operation
krb5kdc: starting...
W20260929 22:58:55.202517 498 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:55 dist-test-slave-512q krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:58:55.316746 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42127
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:55.397225 22008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:55.397507 22008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:55.397547 22008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:55.399214 22008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:55.399263 22008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:55.399281 22008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:55.399295 22008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:55.399309 22008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:55.400889 22008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42127
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:55.401094 22008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:55.401268 22008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:55.406198 22013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:55.406224 22016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:55.406213 22014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:55.406381 22008 server_base.cc:1034] running on GCE node
I20260929 22:58:55.406822 22008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:55.407162 22008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:55.408267 22008 hybrid_clock.cc:648] HybridClock initialized: now 1790722735408261 us; error 39 us; skew 500 ppm
Sep 29 22:58:55 dist-test-slave-512q krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722735, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:55.410848 22008 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:58:55.411369 22008 webserver.cc:460] Webserver started at http://127.0.0.1:33765/ using document root <none> and password file <none>
I20260929 22:58:55.411626 22008 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:55.411702 22008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:55.411870 22008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:55.413111 22008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "c60d3785339841d7923f91e01d5dd58c"
format_stamp: "Formatted at 2026-09-29 22:58:55 on dist-test-slave-512q"
server_key: "609a3568b35546efb75ca94b46b7d331"
server_key_iv: "0e783f291b866f523041c593672e5017"
server_key_version: "encryptionkey@0"
I20260929 22:58:55.413508 22008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "c60d3785339841d7923f91e01d5dd58c"
format_stamp: "Formatted at 2026-09-29 22:58:55 on dist-test-slave-512q"
server_key: "609a3568b35546efb75ca94b46b7d331"
server_key_iv: "0e783f291b866f523041c593672e5017"
server_key_version: "encryptionkey@0"
I20260929 22:58:55.415021 22008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:55.415879 22023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:55.416095 22008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:58:55.416213 22008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "c60d3785339841d7923f91e01d5dd58c"
format_stamp: "Formatted at 2026-09-29 22:58:55 on dist-test-slave-512q"
server_key: "609a3568b35546efb75ca94b46b7d331"
server_key_iv: "0e783f291b866f523041c593672e5017"
server_key_version: "encryptionkey@0"
I20260929 22:58:55.416339 22008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:55.419762 22008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:55.422313 22008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:55.422490 22008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:55.426738 22008 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42127
I20260929 22:58:55.426767 22075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42127 every 8 connection(s)
I20260929 22:58:55.427131 22008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:55.428117 22076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:55.430395 22076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c: Bootstrap starting.
I20260929 22:58:55.430869 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22008
I20260929 22:58:55.430948 22076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:55.431017 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:55.431198 498 external_mini_cluster.cc:1428] Setting key 4ab01f42997f6cc59d7683616c9df91b
I20260929 22:58:55.431244 22076 log.cc:824] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:55.432004 22076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c: No bootstrap required, opened a new log
I20260929 22:58:55.434118 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:55.431782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:57315 (local address 127.0.0.1:42127)
0929 22:58:55.431974 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:55.431983 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:55.432016 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:58:55.432593 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:55.432600 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:55.432628 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:55.432777 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:55.433572 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:55.433580 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:55.433580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:55.433584 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:55.433618 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:55.433628 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:55.433728 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:55.433762 (+ 34us) server_negotiation.cc:299] Negotiation successful
0929 22:58:55.433804 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260929 22:58:55.434054 22076 raft_consensus.cc:348] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } }
I20260929 22:58:55.434219 22076 raft_consensus.cc:374] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:55.434255 22076 raft_consensus.cc:729] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c60d3785339841d7923f91e01d5dd58c, State: Initialized, Role: FOLLOWER
I20260929 22:58:55.434384 22076 consensus_queue.cc:260] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } }
I20260929 22:58:55.434478 22076 raft_consensus.cc:388] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:55.434540 22076 raft_consensus.cc:482] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:55.434597 22076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:55.435220 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:55.435359 22076 raft_consensus.cc:504] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } }
I20260929 22:58:55.435479 22076 leader_election.cc:302] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c60d3785339841d7923f91e01d5dd58c; no voters:
I20260929 22:58:55.435688 22076 leader_election.cc:288] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:55.435714 22081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:55.435818 22081 raft_consensus.cc:686] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [term 1 LEADER]: Becoming Leader. State: Replica: c60d3785339841d7923f91e01d5dd58c, State: Running, Role: LEADER
I20260929 22:58:55.435950 22076 sys_catalog.cc:564] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:55.435969 22081 consensus_queue.cc:237] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } }
I20260929 22:58:55.436439 22081 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c60d3785339841d7923f91e01d5dd58c. Latest consensus state: current_term: 1 leader_uuid: "c60d3785339841d7923f91e01d5dd58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } } }
I20260929 22:58:55.436453 22082 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c60d3785339841d7923f91e01d5dd58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c60d3785339841d7923f91e01d5dd58c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42127 } } }
I20260929 22:58:55.436587 22082 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:55.436789 22094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:55.436537 22081 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:55.437285 22094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:55.438536 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:55.436888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.75:44449 (local address 127.0.0.1:42127)
0929 22:58:55.436917 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:55.436919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:55.437285 (+ 366us) server_negotiation.cc:407] Connection header received
0929 22:58:55.437377 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:55.437377 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:55.437382 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:55.437408 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:55.438237 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:55.438238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:55.438238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:55.438243 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:55.438286 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:55.438290 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:55.438360 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:55.438452 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:58:55.438466 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:58:55.439289 22094 catalog_manager.cc:1347] Generated new cluster ID: bff25c2dcbfc486a885f135c0d2d1c0f
I20260929 22:58:55.439356 22094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:55.453068 22094 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:55.453238 22094 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:55.456640 22094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c60d3785339841d7923f91e01d5dd58c: Generated new TSK 0
I20260929 22:58:55.456825 22094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:55.460466 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22008
2026-09-29T22:58:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1282 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:55 dist-test-slave-512q krb5kdc[22107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:55 dist-test-slave-512q krb5kdc[22107](info): set up 2 sockets
Sep 29 22:58:55 dist-test-slave-512q krb5kdc[22107](info): commencing operation
krb5kdc: starting...
W20260929 22:58:56.495271 498 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:56.610767 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44423
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:33047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:44423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:56.691386 22120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:56.691591 22120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:56.691615 22120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:56.692788 22120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:56.692834 22120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:56.692852 22120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:56.692910 22120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:56.692941 22120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:56.694428 22120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:33047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:44423
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:56.694665 22120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:56.694887 22120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:56.699800 22126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:56.699813 22120 server_base.cc:1034] running on GCE node
W20260929 22:58:56.699769 22128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:56.699780 22125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:56.700350 22120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:56.700666 22120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:56.701835 22120 hybrid_clock.cc:648] HybridClock initialized: now 1790722736701815 us; error 36 us; skew 500 ppm
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722736, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:56.708320 22120 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:56.708783 22120 webserver.cc:460] Webserver started at http://127.0.124.190:34469/ using document root <none> and password file <none>
I20260929 22:58:56.709026 22120 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:56.709095 22120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:56.709244 22120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:56.710315 22120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "626418b2993940e397469b05de0360da"
format_stamp: "Formatted at 2026-09-29 22:58:56 on dist-test-slave-512q"
server_key: "34165ef39e3fb5d18d2fc5e78e10f5f7"
server_key_iv: "8b22fc8578980fe45fa4a641cf31b447"
server_key_version: "encryptionkey@0"
I20260929 22:58:56.710681 22120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "626418b2993940e397469b05de0360da"
format_stamp: "Formatted at 2026-09-29 22:58:56 on dist-test-slave-512q"
server_key: "34165ef39e3fb5d18d2fc5e78e10f5f7"
server_key_iv: "8b22fc8578980fe45fa4a641cf31b447"
server_key_version: "encryptionkey@0"
I20260929 22:58:56.711987 22120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:58:56.712852 22135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:56.713037 22120 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:56.713132 22120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "626418b2993940e397469b05de0360da"
format_stamp: "Formatted at 2026-09-29 22:58:56 on dist-test-slave-512q"
server_key: "34165ef39e3fb5d18d2fc5e78e10f5f7"
server_key_iv: "8b22fc8578980fe45fa4a641cf31b447"
server_key_version: "encryptionkey@0"
I20260929 22:58:56.713219 22120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:56.732448 22120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:56.734261 22120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:56.734423 22120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:56.738381 22120 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:44423
I20260929 22:58:56.738418 22187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:44423 every 8 connection(s)
I20260929 22:58:56.738782 22120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:56.739600 22188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:56.741832 22188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da: Bootstrap starting.
I20260929 22:58:56.742322 22188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:56.742583 22188 log.cc:824] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:56.743201 22188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da: No bootstrap required, opened a new log
I20260929 22:58:56.744793 22188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } }
I20260929 22:58:56.744925 22188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:56.744947 22188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626418b2993940e397469b05de0360da, State: Initialized, Role: FOLLOWER
I20260929 22:58:56.745074 22188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } }
I20260929 22:58:56.745153 22188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:56.745175 22188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:56.745203 22188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:56.745524 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22120
I20260929 22:58:56.745651 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:56.745796 22188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } }
I20260929 22:58:56.745822 498 external_mini_cluster.cc:1428] Setting key 1e3c74d9b4159ffba705efcda43adfdd
I20260929 22:58:56.745903 22188 leader_election.cc:302] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 626418b2993940e397469b05de0360da; no voters:
I20260929 22:58:56.746090 22188 leader_election.cc:288] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:56.746124 22191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:56.746311 22191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [term 1 LEADER]: Becoming Leader. State: Replica: 626418b2993940e397469b05de0360da, State: Running, Role: LEADER
I20260929 22:58:56.746376 22188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:56.746404 22191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } }
I20260929 22:58:56.746694 22191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 626418b2993940e397469b05de0360da. Latest consensus state: current_term: 1 leader_uuid: "626418b2993940e397469b05de0360da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } } }
I20260929 22:58:56.746835 22191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:56.746843 22193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "626418b2993940e397469b05de0360da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626418b2993940e397469b05de0360da" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44423 } } }
I20260929 22:58:56.746997 22193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:56.747378 22200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:56.747918 22200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:56.750452 22200 catalog_manager.cc:1347] Generated new cluster ID: 191b9bf27db84f20b968f6ac1f423918
I20260929 22:58:56.750505 22200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:58:56.758466 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:56.746430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49415 (local address 127.0.124.190:44423)
0929 22:58:56.746679 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:56.746689 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:56.747227 (+ 538us) server_negotiation.cc:407] Connection header received
0929 22:58:56.747385 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:56.747393 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:56.747451 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:56.747589 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:56.748551 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:56.749471 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:56.750580 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:56.751250 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:56.751364 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:56.754151 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:56.754155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:56.754156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:56.754168 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:56.756720 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:56.757180 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:56.757183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:56.757183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:56.757293 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:56.757545 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:56.757545 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:56.757545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:56.757841 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:56.757997 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:56.758146 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 22:58:56.758239 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":60,"threads_started":1}
I20260929 22:58:56.759677 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:56.761610 22200 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:56.762315 22200 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:56.768265 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:56.761086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56697 (local address 127.0.124.190:44423)
0929 22:58:56.761119 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:56.761121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:56.761248 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:58:56.761357 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:56.761358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:56.761367 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:56.761417 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:56.762173 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:56.762890 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:56.763871 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:56.764182 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:56.764245 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:56.765611 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:56.765612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:56.765612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:58:56.765618 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:56.767072 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:56.767445 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:56.767446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:56.767447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:56.767490 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:58:56.767681 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:58:56.767682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:58:56.767682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:58:56.767786 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:56.767864 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:56.768069 (+ 205us) server_negotiation.cc:299] Negotiation successful
0929 22:58:56.768127 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:58:56.769150 22200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 626418b2993940e397469b05de0360da: Generated new TSK 0
I20260929 22:58:56.769323 22200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:56.772811 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22120
W20260929 22:58:56.776976 22105 connection.cc:535] client connection to 127.0.124.190:44423 recv error: Network error: failed to read from TLS socket (remote: 127.0.124.190:44423): Connection reset by peer (error 104)
2026-09-29T22:58:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1312 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22219](info): set up 2 sockets
Sep 29 22:58:56 dist-test-slave-512q krb5kdc[22219](info): commencing operation
krb5kdc: starting...
W20260929 22:58:57.819061 498 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:57 dist-test-slave-512q krb5kdc[22219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:57.932801 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33859
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:58.010530 22232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:58.010774 22232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:58.010813 22232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:58.011963 22232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:58.012042 22232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:58.012069 22232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:58.012102 22232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:58.012133 22232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:58.013625 22232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33859
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:58.013903 22232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:58.014128 22232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:58.018901 22240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:58.018920 22238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:58.019095 22232 server_base.cc:1034] running on GCE node
W20260929 22:58:58.018908 22237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:58.019366 22232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:58.019589 22232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:58.020722 22232 hybrid_clock.cc:648] HybridClock initialized: now 1790722738020701 us; error 37 us; skew 500 ppm
Sep 29 22:58:58 dist-test-slave-512q krb5kdc[22219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722738, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:58.023177 22232 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:58.023608 22232 webserver.cc:460] Webserver started at http://127.0.124.190:42393/ using document root <none> and password file <none>
I20260929 22:58:58.023783 22232 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:58.023823 22232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:58.023907 22232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:58.024925 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "53c0997fc9804b6bb9179d9e3b9cd84b"
format_stamp: "Formatted at 2026-09-29 22:58:58 on dist-test-slave-512q"
server_key: "9575e620e92fa7c06069f41750f2b3a0"
server_key_iv: "1d26393f996fd5578605cf4cf35ded2f"
server_key_version: "encryptionkey@0"
I20260929 22:58:58.025223 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "53c0997fc9804b6bb9179d9e3b9cd84b"
format_stamp: "Formatted at 2026-09-29 22:58:58 on dist-test-slave-512q"
server_key: "9575e620e92fa7c06069f41750f2b3a0"
server_key_iv: "1d26393f996fd5578605cf4cf35ded2f"
server_key_version: "encryptionkey@0"
I20260929 22:58:58.026418 22232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:58:58.027132 22247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:58.027303 22232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:58:58.027400 22232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "53c0997fc9804b6bb9179d9e3b9cd84b"
format_stamp: "Formatted at 2026-09-29 22:58:58 on dist-test-slave-512q"
server_key: "9575e620e92fa7c06069f41750f2b3a0"
server_key_iv: "1d26393f996fd5578605cf4cf35ded2f"
server_key_version: "encryptionkey@0"
I20260929 22:58:58.027479 22232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:58.046541 22232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:58.048906 22232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:58.049074 22232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:58.053017 22232 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:33859
I20260929 22:58:58.053049 22299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:33859 every 8 connection(s)
I20260929 22:58:58.053382 22232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:58.054234 22300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:58.056466 22300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b: Bootstrap starting.
I20260929 22:58:58.057076 22300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:58.057112 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22232
I20260929 22:58:58.057209 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:58.057402 498 external_mini_cluster.cc:1428] Setting key bf5fcc0ac3058dea4a43de3d7ad8998a
I20260929 22:58:58.057418 22300 log.cc:824] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:58.058183 22300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b: No bootstrap required, opened a new log
I20260929 22:58:58.060170 22300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } }
I20260929 22:58:58.060366 22300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:58.060393 22300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c0997fc9804b6bb9179d9e3b9cd84b, State: Initialized, Role: FOLLOWER
I20260929 22:58:58.060540 22300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } }
I20260929 22:58:58.060611 22300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:58.060632 22300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:58.060693 22300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:58.061244 22300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } }
I20260929 22:58:58.061388 22300 leader_election.cc:302] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53c0997fc9804b6bb9179d9e3b9cd84b; no voters:
I20260929 22:58:58.061556 22300 leader_election.cc:288] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:58.061582 22305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:58.061758 22305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [term 1 LEADER]: Becoming Leader. State: Replica: 53c0997fc9804b6bb9179d9e3b9cd84b, State: Running, Role: LEADER
I20260929 22:58:58.061862 22300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:58.061877 22305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } }
I20260929 22:58:58.062186 22305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53c0997fc9804b6bb9179d9e3b9cd84b. Latest consensus state: current_term: 1 leader_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } } }
I20260929 22:58:58.062266 22305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:58.062474 22311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:58.062613 22306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53c0997fc9804b6bb9179d9e3b9cd84b" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33859 } } }
I20260929 22:58:58.062830 22306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:58.063059 22304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:58.057915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54761 (local address 127.0.124.190:33859)
0929 22:58:58.058097 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:58.058107 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:58.058137 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:58:58.058584 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:58.058591 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:58.058637 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:58.058800 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:58.058982 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:58.059845 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:58.060905 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:58.061417 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:58.061555 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:58.062206 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:58.062212 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:58.062213 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:58.062442 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:58.062481 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:58.062497 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:58.062573 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:58.062715 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:58:58.062747 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260929 22:58:58.063223 22311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:58.064014 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:58.064685 22311 catalog_manager.cc:1347] Generated new cluster ID: 23e96ebd88a94d65a957a2cda02ab0cc
I20260929 22:58:58.064733 22311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:58.068861 22304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:58.065481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42095 (local address 127.0.124.190:33859)
0929 22:58:58.065523 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:58.065525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:58.065583 (+ 58us) server_negotiation.cc:407] Connection header received
0929 22:58:58.065665 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:58.065666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:58.065675 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:58.065725 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:58.065858 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:58.066551 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:58.067572 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:58:58.067882 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:58:58.067939 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:58:58.068614 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:58.068615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:58.068616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:58.068619 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:58.068633 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:58.068636 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:58.068690 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:58.068781 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 22:58:58.068791 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:58:58.086042 22311 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:58.086699 22311 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:58.091207 22311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53c0997fc9804b6bb9179d9e3b9cd84b: Generated new TSK 0
I20260929 22:58:58.091403 22311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:58.094357 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22232
W20260929 22:58:58.098464 22217 connection.cc:535] client connection to 127.0.124.190:33859 recv error: Network error: failed to read from TLS socket (remote: 127.0.124.190:33859): Connection reset by peer (error 104)
2026-09-29T22:58:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1321 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:58 dist-test-slave-512q krb5kdc[22331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:58 dist-test-slave-512q krb5kdc[22331](info): set up 2 sockets
Sep 29 22:58:58 dist-test-slave-512q krb5kdc[22331](info): commencing operation
krb5kdc: starting...
W20260929 22:58:59.122435 498 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:58:59 dist-test-slave-512q krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:58:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:58:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:58:59.234668 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40261
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:40261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:58:59.314504 22344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:58:59.314682 22344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:58:59.314702 22344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:58:59.315825 22344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:58:59.315865 22344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:58:59.315879 22344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:58:59.315892 22344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:58:59.315904 22344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:58:59.317368 22344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:40261
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:40261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:58:59.317605 22344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:58:59.317811 22344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:58:59.322604 22349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:58:59.322674 22352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:59.322866 22344 server_base.cc:1034] running on GCE node
W20260929 22:58:59.322607 22350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:58:59.323189 22344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:58:59.323473 22344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:58:59.324640 22344 hybrid_clock.cc:648] HybridClock initialized: now 1790722739324634 us; error 37 us; skew 500 ppm
Sep 29 22:58:59 dist-test-slave-512q krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722739, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:58:59.327051 22344 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:58:59.327517 22344 webserver.cc:460] Webserver started at http://127.0.124.190:42299/ using document root <none> and password file <none>
I20260929 22:58:59.327739 22344 fs_manager.cc:359] Metadata directory not provided
I20260929 22:58:59.327805 22344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:58:59.327975 22344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:58:59.329079 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "2ffacd32e3874d3a92e239fbe90bac35"
format_stamp: "Formatted at 2026-09-29 22:58:59 on dist-test-slave-512q"
server_key: "9681957649f5642db1b786933b5b5a4d"
server_key_iv: "613ac3c6a2460f0a40410d46ec8f84ee"
server_key_version: "encryptionkey@0"
I20260929 22:58:59.329439 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "2ffacd32e3874d3a92e239fbe90bac35"
format_stamp: "Formatted at 2026-09-29 22:58:59 on dist-test-slave-512q"
server_key: "9681957649f5642db1b786933b5b5a4d"
server_key_iv: "613ac3c6a2460f0a40410d46ec8f84ee"
server_key_version: "encryptionkey@0"
I20260929 22:58:59.330729 22344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:58:59.331439 22359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:58:59.331619 22344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:58:59.331717 22344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "2ffacd32e3874d3a92e239fbe90bac35"
format_stamp: "Formatted at 2026-09-29 22:58:59 on dist-test-slave-512q"
server_key: "9681957649f5642db1b786933b5b5a4d"
server_key_iv: "613ac3c6a2460f0a40410d46ec8f84ee"
server_key_version: "encryptionkey@0"
I20260929 22:58:59.331801 22344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:58:59.335136 22344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:58:59.337460 22344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:58:59.337621 22344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:58:59.341445 22344 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:40261
I20260929 22:58:59.341495 22411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:40261 every 8 connection(s)
I20260929 22:58:59.341802 22344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:58:59.342708 22412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:58:59.344941 22412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: Bootstrap starting.
I20260929 22:58:59.345489 22412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: Neither blocks nor log segments found. Creating new log.
I20260929 22:58:59.345759 22412 log.cc:824] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: Log is configured to *not* fsync() on all Append() calls
I20260929 22:58:59.346411 22412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: No bootstrap required, opened a new log
I20260929 22:58:59.347955 22412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } }
I20260929 22:58:59.348083 22412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:58:59.348105 22412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ffacd32e3874d3a92e239fbe90bac35, State: Initialized, Role: FOLLOWER
I20260929 22:58:59.348340 22412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } }
I20260929 22:58:59.348405 22412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:58:59.348426 22412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:58:59.348466 22412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:58:59.348665 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22344
I20260929 22:58:59.348766 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:58:59.348927 498 external_mini_cluster.cc:1428] Setting key bcabbf5c63df4e079b9dacb911717067
I20260929 22:58:59.349119 22412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } }
I20260929 22:58:59.349236 22412 leader_election.cc:302] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ffacd32e3874d3a92e239fbe90bac35; no voters:
I20260929 22:58:59.349421 22412 leader_election.cc:288] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:58:59.349453 22416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:58:59.349634 22416 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [term 1 LEADER]: Becoming Leader. State: Replica: 2ffacd32e3874d3a92e239fbe90bac35, State: Running, Role: LEADER
I20260929 22:58:59.349645 22412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:58:59.349756 22416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } }
I20260929 22:58:59.350173 22419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ffacd32e3874d3a92e239fbe90bac35. Latest consensus state: current_term: 1 leader_uuid: "2ffacd32e3874d3a92e239fbe90bac35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } } }
I20260929 22:58:59.350270 22419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:59.350337 22418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ffacd32e3874d3a92e239fbe90bac35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ffacd32e3874d3a92e239fbe90bac35" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 40261 } } }
I20260929 22:58:59.350461 22418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35 [sys.catalog]: This master's current role is: LEADER
I20260929 22:58:59.351706 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:59.349332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37519 (local address 127.0.124.190:40261)
0929 22:58:59.350124 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:59.350133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:59.350182 (+ 49us) server_negotiation.cc:407] Connection header received
0929 22:58:59.350310 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:59.350318 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:59.350357 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:59.350783 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:59.351280 (+ 497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:59.351284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:59.351284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:59.351289 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:59.351325 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:59.351341 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:59.351423 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:59.351475 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:58:59.351512 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":68,"threads_started":1}
W20260929 22:58:59.351799 22432 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:58:59.351873 22432 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:58:59.352025 22425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:58:59.352186 22425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:58:59.352584 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:58:59.353803 22425 catalog_manager.cc:1347] Generated new cluster ID: 61688d9c83be41a4a80092ab9d2067c3
I20260929 22:58:59.353849 22425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:58:59.355187 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:58:59.354031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56439 (local address 127.0.124.190:40261)
0929 22:58:59.354063 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:58:59.354065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:58:59.354203 (+ 138us) server_negotiation.cc:407] Connection header received
0929 22:58:59.354285 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:58:59.354286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:58:59.354290 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:58:59.354359 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:58:59.354937 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:58:59.354938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:58:59.354938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:58:59.354943 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:58:59.354956 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:58:59.354960 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:58:59.355022 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:58:59.355076 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:58:59.355101 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:58:59.370446 22425 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:58:59.370586 22425 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:58:59.391752 22425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ffacd32e3874d3a92e239fbe90bac35: Generated new TSK 0
I20260929 22:58:59.391938 22425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:58:59.396646 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22344
2026-09-29T22:58:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1302 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:58:59 dist-test-slave-512q krb5kdc[22443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:58:59 dist-test-slave-512q krb5kdc[22443](info): set up 2 sockets
Sep 29 22:58:59 dist-test-slave-512q krb5kdc[22443](info): commencing operation
krb5kdc: starting...
W20260929 22:59:00.450511 498 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:59:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:59:00.562727 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33007
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:59:00.641904 22456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:00.642130 22456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:00.642167 22456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:00.643347 22456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:00.643414 22456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:00.643437 22456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:00.643464 22456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:00.643496 22456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:00.644946 22456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:00.645208 22456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:00.645412 22456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:00.650166 22464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:00.650195 22461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:00.650301 22456 server_base.cc:1034] running on GCE node
W20260929 22:59:00.650195 22462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:00.650655 22456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:00.651000 22456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:00.652151 22456 hybrid_clock.cc:648] HybridClock initialized: now 1790722740652133 us; error 39 us; skew 500 ppm
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722740, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:00.654597 22456 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:59:00.655004 22456 webserver.cc:460] Webserver started at http://127.0.124.190:45197/ using document root <none> and password file <none>
I20260929 22:59:00.655231 22456 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:00.655299 22456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:00.655444 22456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:00.656541 22456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "ff083afcc8b74ef190fef83e628d7237"
format_stamp: "Formatted at 2026-09-29 22:59:00 on dist-test-slave-512q"
server_key: "0608f63131bbd1d06b487d53670a4783"
server_key_iv: "9518aac6b0b4bc2f83a4f6cfe43b935e"
server_key_version: "encryptionkey@0"
I20260929 22:59:00.656922 22456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "ff083afcc8b74ef190fef83e628d7237"
format_stamp: "Formatted at 2026-09-29 22:59:00 on dist-test-slave-512q"
server_key: "0608f63131bbd1d06b487d53670a4783"
server_key_iv: "9518aac6b0b4bc2f83a4f6cfe43b935e"
server_key_version: "encryptionkey@0"
I20260929 22:59:00.658236 22456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:59:00.658978 22471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:00.659157 22456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:59:00.659252 22456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "ff083afcc8b74ef190fef83e628d7237"
format_stamp: "Formatted at 2026-09-29 22:59:00 on dist-test-slave-512q"
server_key: "0608f63131bbd1d06b487d53670a4783"
server_key_iv: "9518aac6b0b4bc2f83a4f6cfe43b935e"
server_key_version: "encryptionkey@0"
I20260929 22:59:00.659346 22456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:00.670459 22456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:00.672396 22456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:00.672593 22456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:00.676843 22456 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:33007
I20260929 22:59:00.676884 22523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:33007 every 8 connection(s)
I20260929 22:59:00.677248 22456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:59:00.678094 22524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:00.680189 22524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237: Bootstrap starting.
I20260929 22:59:00.680895 22524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:00.681227 22524 log.cc:824] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:00.682101 22524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237: No bootstrap required, opened a new log
I20260929 22:59:00.683660 22524 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } }
I20260929 22:59:00.683868 22524 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:59:00.683921 22524 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff083afcc8b74ef190fef83e628d7237, State: Initialized, Role: FOLLOWER
I20260929 22:59:00.684077 22524 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } }
I20260929 22:59:00.684163 22524 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:59:00.684192 22524 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:59:00.684265 22524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:00.684819 22524 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } }
I20260929 22:59:00.684900 22524 leader_election.cc:302] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff083afcc8b74ef190fef83e628d7237; no voters:
I20260929 22:59:00.685014 22524 leader_election.cc:288] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:59:00.685062 22527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:59:00.685263 22527 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [term 1 LEADER]: Becoming Leader. State: Replica: ff083afcc8b74ef190fef83e628d7237, State: Running, Role: LEADER
I20260929 22:59:00.685310 22524 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:00.685352 22527 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } }
I20260929 22:59:00.685714 22529 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff083afcc8b74ef190fef83e628d7237. Latest consensus state: current_term: 1 leader_uuid: "ff083afcc8b74ef190fef83e628d7237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } } }
I20260929 22:59:00.685839 22528 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff083afcc8b74ef190fef83e628d7237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff083afcc8b74ef190fef83e628d7237" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33007 } } }
I20260929 22:59:00.685849 22529 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:00.685933 22528 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:00.686246 22536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:59:00.686769 22536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:59:00.687183 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22456
I20260929 22:59:00.687323 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:59:00.687487 498 external_mini_cluster.cc:1428] Setting key 2c22dc1b1b91fbfa416257794d206da9
I20260929 22:59:00.688434 22536 catalog_manager.cc:1347] Generated new cluster ID: b81e7ccc4915478b85094fac272d5cce
I20260929 22:59:00.688486 22536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:00.697459 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:00.688106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59605 (local address 127.0.124.190:33007)
0929 22:59:00.688524 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:00.688533 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:00.688568 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:59:00.688673 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:00.688679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:00.688719 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:00.688866 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:00.689495 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:00.690422 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:00.691205 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:00.691624 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:00.691917 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:00.694112 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:00.694116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:00.694116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:00.694128 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:00.695790 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:00.696181 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:00.696184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:00.696184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:00.696353 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:00.696562 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:00.696563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:00.696563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:00.696792 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:00.696947 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:00.697060 (+ 113us) server_negotiation.cc:299] Negotiation successful
0929 22:59:00.697301 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":54,"threads_started":1}
I20260929 22:59:00.698340 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:59:00.703171 22536 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:59:00.703812 22536 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:59:00.706379 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:00.699678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58841 (local address 127.0.124.190:33007)
0929 22:59:00.699714 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:00.699716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:00.700392 (+ 676us) server_negotiation.cc:407] Connection header received
0929 22:59:00.700464 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:00.700465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:00.700478 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:00.700530 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:00.701028 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:00.701524 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:00.702201 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:00.702408 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:00.702479 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:00.703752 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:00.703753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:00.703753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:00.703759 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:00.705185 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:00.705559 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:00.705560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:00.705560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:00.705612 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:00.705828 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:00.705829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:00.705829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:00.705938 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:00.706043 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:00.706172 (+ 129us) server_negotiation.cc:299] Negotiation successful
0929 22:59:00.706273 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:59:00.711354 22536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff083afcc8b74ef190fef83e628d7237: Generated new TSK 0
I20260929 22:59:00.711541 22536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:59:00.713932 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22456
2026-09-29T22:59:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22555](info): set up 2 sockets
Sep 29 22:59:00 dist-test-slave-512q krb5kdc[22555](info): commencing operation
krb5kdc: starting...
W20260929 22:59:01.746524 498 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:59:01 dist-test-slave-512q krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:59:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:59:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:59:01.860772 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44045
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:37343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:44045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:59:01.944487 22568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:01.944731 22568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:01.944774 22568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:01.946064 22568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:01.946135 22568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:01.946163 22568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:01.946197 22568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:01.946223 22568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:01.947808 22568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:37343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:44045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:44045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:01.948108 22568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:01.948380 22568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:01.953661 22573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:01.953632 22574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:01.953730 22568 server_base.cc:1034] running on GCE node
W20260929 22:59:01.953646 22576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:01.954136 22568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:01.954437 22568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:01.955662 22568 hybrid_clock.cc:648] HybridClock initialized: now 1790722741955647 us; error 45 us; skew 500 ppm
Sep 29 22:59:01 dist-test-slave-512q krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722741, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:01.962657 22568 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:59:01.963111 22568 webserver.cc:460] Webserver started at http://127.0.124.190:43279/ using document root <none> and password file <none>
I20260929 22:59:01.963313 22568 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:01.963354 22568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:01.963440 22568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:01.964509 22568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "f0f14c3c9fd64373983d78b9c24dc15d"
format_stamp: "Formatted at 2026-09-29 22:59:01 on dist-test-slave-512q"
server_key: "0914cae997a46c58b30bcb077e30d16a"
server_key_iv: "e542518af6d2a16439cc135afb675331"
server_key_version: "encryptionkey@0"
I20260929 22:59:01.964800 22568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "f0f14c3c9fd64373983d78b9c24dc15d"
format_stamp: "Formatted at 2026-09-29 22:59:01 on dist-test-slave-512q"
server_key: "0914cae997a46c58b30bcb077e30d16a"
server_key_iv: "e542518af6d2a16439cc135afb675331"
server_key_version: "encryptionkey@0"
I20260929 22:59:01.965994 22568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:59:01.966610 22583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:01.966780 22568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:59:01.966866 22568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "f0f14c3c9fd64373983d78b9c24dc15d"
format_stamp: "Formatted at 2026-09-29 22:59:01 on dist-test-slave-512q"
server_key: "0914cae997a46c58b30bcb077e30d16a"
server_key_iv: "e542518af6d2a16439cc135afb675331"
server_key_version: "encryptionkey@0"
I20260929 22:59:01.966918 22568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:01.976755 22568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:01.978403 22568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:01.978506 22568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:01.982168 22568 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:44045
I20260929 22:59:01.982256 22635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:44045 every 8 connection(s)
I20260929 22:59:01.982570 22568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:59:01.983382 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:01.984948 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22568
I20260929 22:59:01.985059 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:59:01.985248 498 external_mini_cluster.cc:1428] Setting key 233ee0c3bd8e46729921e12d541afb40
I20260929 22:59:01.985965 22636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: Bootstrap starting.
I20260929 22:59:01.986521 22636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:01.986867 22636 log.cc:824] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:01.987566 22636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: No bootstrap required, opened a new log
I20260929 22:59:01.989892 22636 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } }
I20260929 22:59:01.990036 22636 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:59:01.990057 22636 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f14c3c9fd64373983d78b9c24dc15d, State: Initialized, Role: FOLLOWER
I20260929 22:59:01.990207 22636 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } }
I20260929 22:59:01.990281 22636 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:59:01.990314 22636 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:59:01.990358 22636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:01.991109 22636 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } }
I20260929 22:59:01.991219 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:01.985764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54259 (local address 127.0.124.190:44045)
0929 22:59:01.985948 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:01.985958 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:01.985989 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:59:01.986436 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:01.986442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:01.986485 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:01.986646 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:01.986949 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:01.988024 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:01.989126 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:01.989504 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:01.989589 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:01.990494 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:01.990498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:01.990498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:59:01.990694 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:01.990731 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:59:01.990745 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:01.990813 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:01.990916 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 22:59:01.990985 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260929 22:59:01.991217 22636 leader_election.cc:302] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0f14c3c9fd64373983d78b9c24dc15d; no voters:
I20260929 22:59:01.991412 22636 leader_election.cc:288] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:59:01.991456 22641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:59:01.991655 22636 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:01.991653 22641 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [term 1 LEADER]: Becoming Leader. State: Replica: f0f14c3c9fd64373983d78b9c24dc15d, State: Running, Role: LEADER
I20260929 22:59:01.992007 22641 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } }
I20260929 22:59:01.992134 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:59:01.992367 22641 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0f14c3c9fd64373983d78b9c24dc15d. Latest consensus state: current_term: 1 leader_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } } }
I20260929 22:59:01.992434 22641 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:01.992530 22643 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0f14c3c9fd64373983d78b9c24dc15d" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 44045 } } }
I20260929 22:59:01.992650 22643 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d [sys.catalog]: This master's current role is: LEADER
W20260929 22:59:01.993616 22658 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:01.993682 22658 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:01.994385 22650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:59:01.994565 22650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:59:01.995990 22650 catalog_manager.cc:1347] Generated new cluster ID: d7c23f9397194c569aee7a94304ac72f
I20260929 22:59:01.996048 22650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:59:01.996757 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:01.993607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60121 (local address 127.0.124.190:44045)
0929 22:59:01.993643 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:01.993644 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:01.993769 (+ 125us) server_negotiation.cc:407] Connection header received
0929 22:59:01.993874 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:01.993875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:01.993886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:01.993936 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:01.994066 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:01.994741 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:01.995454 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:01.995743 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:01.995814 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:01.996496 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:01.996497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:01.996497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:59:01.996501 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:01.996523 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:59:01.996527 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:01.996580 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:01.996667 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 22:59:01.996689 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:59:02.006918 22650 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:59:02.007429 22650 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:59:02.009589 22650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0f14c3c9fd64373983d78b9c24dc15d: Generated new TSK 0
I20260929 22:59:02.009756 22650 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:59:02.017938 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22568
2026-09-29T22:59:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1302 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:59:02 dist-test-slave-512q krb5kdc[22667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:59:02 dist-test-slave-512q krb5kdc[22667](info): set up 2 sockets
Sep 29 22:59:02 dist-test-slave-512q krb5kdc[22667](info): commencing operation
krb5kdc: starting...
W20260929 22:59:03.050516 498 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:59:03 dist-test-slave-512q krb5kdc[22667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:59:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:59:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:59:03.164443 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35521
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:35521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:59:03.243305 22680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:03.243507 22680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:03.243530 22680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:03.244720 22680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:03.244760 22680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:03.244786 22680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:03.244798 22680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:03.244810 22680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:03.246248 22680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:35521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:35521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:03.246505 22680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:03.246712 22680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:03.251446 22685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:03.251453 22686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:03.251490 22680 server_base.cc:1034] running on GCE node
W20260929 22:59:03.251453 22688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:03.251962 22680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:03.252197 22680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:03.253393 22680 hybrid_clock.cc:648] HybridClock initialized: now 1790722743253370 us; error 41 us; skew 500 ppm
Sep 29 22:59:03 dist-test-slave-512q krb5kdc[22667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722743, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:03.255683 22680 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:59:03.256034 22680 webserver.cc:460] Webserver started at http://127.0.124.190:46845/ using document root <none> and password file <none>
I20260929 22:59:03.256273 22680 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:03.256330 22680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:03.256417 22680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:03.257402 22680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "a34f77f3dac345718565c778660dc107"
format_stamp: "Formatted at 2026-09-29 22:59:03 on dist-test-slave-512q"
server_key: "9f8ccecd2a5eeb1cf039917c18e005b5"
server_key_iv: "f8cd5a99fec4d8b669da4af6440579e2"
server_key_version: "encryptionkey@0"
I20260929 22:59:03.257680 22680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "a34f77f3dac345718565c778660dc107"
format_stamp: "Formatted at 2026-09-29 22:59:03 on dist-test-slave-512q"
server_key: "9f8ccecd2a5eeb1cf039917c18e005b5"
server_key_iv: "f8cd5a99fec4d8b669da4af6440579e2"
server_key_version: "encryptionkey@0"
I20260929 22:59:03.258844 22680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:59:03.259523 22695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:03.259677 22680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:59:03.259768 22680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "a34f77f3dac345718565c778660dc107"
format_stamp: "Formatted at 2026-09-29 22:59:03 on dist-test-slave-512q"
server_key: "9f8ccecd2a5eeb1cf039917c18e005b5"
server_key_iv: "f8cd5a99fec4d8b669da4af6440579e2"
server_key_version: "encryptionkey@0"
I20260929 22:59:03.259841 22680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:03.262961 22680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:03.264725 22680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:03.264876 22680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:03.268471 22680 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:35521
I20260929 22:59:03.268528 22747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:35521 every 8 connection(s)
I20260929 22:59:03.268818 22680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:59:03.269162 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22680
I20260929 22:59:03.269276 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:59:03.269483 498 external_mini_cluster.cc:1428] Setting key b5a6e4e70074c136da13bb5632ca2f9f
I20260929 22:59:03.269938 22748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:03.271728 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:03.269972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55757 (local address 127.0.124.190:35521)
0929 22:59:03.270115 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:03.270123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:03.270171 (+ 48us) server_negotiation.cc:407] Connection header received
0929 22:59:03.270564 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:03.270570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:03.270591 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:03.270698 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:03.271284 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:03.271287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:03.271287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:59:03.271290 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:03.271325 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:59:03.271335 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:03.271400 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:03.271484 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 22:59:03.271512 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
I20260929 22:59:03.272630 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:59:03.273134 22748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107: Bootstrap starting.
I20260929 22:59:03.273837 22748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:03.274186 22748 log.cc:824] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:03.275063 22748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107: No bootstrap required, opened a new log
I20260929 22:59:03.275168 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:03.274174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60135 (local address 127.0.124.190:35521)
0929 22:59:03.274209 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:03.274211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:03.274250 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:59:03.274316 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:03.274317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:03.274321 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:03.274406 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:03.274972 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:03.274973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:03.274974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:59:03.274978 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:03.274992 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:59:03.274997 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:03.275065 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:03.275106 (+ 41us) server_negotiation.cc:299] Negotiation successful
0929 22:59:03.275119 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:59:03.277024 22748 raft_consensus.cc:348] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } }
I20260929 22:59:03.277166 22748 raft_consensus.cc:374] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:59:03.277213 22748 raft_consensus.cc:729] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a34f77f3dac345718565c778660dc107, State: Initialized, Role: FOLLOWER
I20260929 22:59:03.277324 22748 consensus_queue.cc:260] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } }
I20260929 22:59:03.277458 22748 raft_consensus.cc:388] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:59:03.277501 22748 raft_consensus.cc:482] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:59:03.277560 22748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:03.278035 22748 raft_consensus.cc:504] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } }
I20260929 22:59:03.278147 22748 leader_election.cc:302] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a34f77f3dac345718565c778660dc107; no voters:
I20260929 22:59:03.278327 22748 leader_election.cc:288] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:59:03.278368 22758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:59:03.278541 22758 raft_consensus.cc:686] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [term 1 LEADER]: Becoming Leader. State: Replica: a34f77f3dac345718565c778660dc107, State: Running, Role: LEADER
I20260929 22:59:03.278555 22748 sys_catalog.cc:564] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:03.278671 22758 consensus_queue.cc:237] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } }
I20260929 22:59:03.279175 22760 sys_catalog.cc:455] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a34f77f3dac345718565c778660dc107. Latest consensus state: current_term: 1 leader_uuid: "a34f77f3dac345718565c778660dc107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } } }
I20260929 22:59:03.279279 22760 sys_catalog.cc:458] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:03.279594 22767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:59:03.280133 22767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:59:03.279167 22759 sys_catalog.cc:455] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a34f77f3dac345718565c778660dc107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34f77f3dac345718565c778660dc107" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 35521 } } }
I20260929 22:59:03.280771 22759 sys_catalog.cc:458] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:03.281556 22767 catalog_manager.cc:1347] Generated new cluster ID: 430d94a39d0b4d1186f459a5b28a6351
I20260929 22:59:03.281608 22767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:59:03.292387 22767 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:59:03.292541 22767 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:59:03.295959 22767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a34f77f3dac345718565c778660dc107: Generated new TSK 0
I20260929 22:59:03.296113 22767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:59:03.303468 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22680
2026-09-29T22:59:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1285 ms)
[----------] 18 tests from AuthTokenIssuingTest (23441 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:59:03 dist-test-slave-512q krb5kdc[22779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:59:03 dist-test-slave-512q krb5kdc[22779](info): set up 2 sockets
Sep 29 22:59:03 dist-test-slave-512q krb5kdc[22779](info): commencing operation
krb5kdc: starting...
W20260929 22:59:04.334683 498 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:59:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:59:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:59:04.446352 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33167
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:59:04.525372 22792 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:04.525573 22792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:04.525591 22792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:04.525611 22792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:04.526650 22792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:04.526695 22792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:04.526710 22792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:04.526721 22792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:04.526732 22792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:04.528093 22792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:33167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:04.528355 22792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:04.528532 22792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:04.533284 22800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:04.533257 22798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:04.533267 22797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:04.533341 22792 server_base.cc:1034] running on GCE node
I20260929 22:59:04.533687 22792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:04.533958 22792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:04.535125 22792 hybrid_clock.cc:648] HybridClock initialized: now 1790722744535110 us; error 46 us; skew 500 ppm
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:04.537484 22792 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:59:04.537942 22792 webserver.cc:460] Webserver started at http://127.0.124.190:46557/ using document root <none> and password file <none>
I20260929 22:59:04.538172 22792 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:04.538240 22792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:04.538388 22792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:04.539362 22792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "2c51a66fcea44c5c993564af957ce5f0"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "b179abf8b296ead23448575bd0d35185"
server_key_iv: "02ce81a370c517863d40ca7ade6bccc4"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.539712 22792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "2c51a66fcea44c5c993564af957ce5f0"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "b179abf8b296ead23448575bd0d35185"
server_key_iv: "02ce81a370c517863d40ca7ade6bccc4"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.541044 22792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:59:04.541743 22807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:04.541904 22792 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:04.542002 22792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "2c51a66fcea44c5c993564af957ce5f0"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "b179abf8b296ead23448575bd0d35185"
server_key_iv: "02ce81a370c517863d40ca7ade6bccc4"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.542078 22792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:04.574033 22792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:04.576472 22792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:04.576637 22792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:04.580354 22792 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:33167
I20260929 22:59:04.580408 22859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:33167 every 8 connection(s)
I20260929 22:59:04.580807 22792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:59:04.581736 22860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:04.583250 22860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:04.590879 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22792
I20260929 22:59:04.590996 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:59:04.591153 498 external_mini_cluster.cc:1428] Setting key 9b5381d298bcc0f81e627d71faf97baf
I20260929 22:59:04.592208 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.583929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47800 (local address 127.0.124.190:33167)
0929 22:59:04.584078 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.584085 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.584152 (+ 67us) server_negotiation.cc:407] Connection header received
0929 22:59:04.584662 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.584663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.584680 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.584759 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.585248 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.586039 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.586834 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.587131 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.587209 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.589093 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.589100 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.589100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.589106 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.590668 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.591068 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.591070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.591071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.591157 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.591374 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.591375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.591375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.591585 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.591673 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.591850 (+ 177us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.591976 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":87,"threads_started":1}
I20260929 22:59:04.592226 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.583881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33167 (local address 127.0.0.1:47800)
0929 22:59:04.584035 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.584080 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.584532 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.584785 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.584788 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.585010 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.585171 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.585174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.586121 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.586122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.586768 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.586769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.587213 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.587214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.587262 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.587656 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.587664 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.589023 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.590764 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.590770 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.590771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.590978 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.591225 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.591226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.591226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.591308 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.591655 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.591660 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.591718 (+ 58us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.591819 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.592037 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":90,"thread_start_us":84,"threads_started":1}
I20260929 22:59:04.593111 22860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.593463 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.593354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:36976)
0929 22:59:04.593404 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.593443 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:59:04.593616 22809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
I20260929 22:59:04.594023 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.593943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:36992)
0929 22:59:04.593984 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.594007 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:59:04.594142 22860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:45297: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.0.124.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
I20260929 22:59:04.614351 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:45297
--webserver_interface=127.0.124.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:59:04.643381 22860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } attempt: 1
I20260929 22:59:04.643983 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.643829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37000)
0929 22:59:04.643909 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.643951 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260929 22:59:04.644436 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.644305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37016)
0929 22:59:04.644358 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.644407 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 22:59:04.644542 22860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:45297: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
W20260929 22:59:04.693794 22867 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:04.694007 22867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:04.694024 22867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:04.694043 22867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:04.695086 22867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:04.695120 22867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:04.695133 22867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:04.695145 22867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:04.695158 22867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:04.696568 22867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:45297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.124.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:04.696815 22867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:04.697048 22867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:04.701941 22873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:04.701979 22872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:04.702191 22875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:04.702163 22867 server_base.cc:1034] running on GCE node
I20260929 22:59:04.702467 22867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:04.702693 22867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:04.703857 22867 hybrid_clock.cc:648] HybridClock initialized: now 1790722744703850 us; error 32 us; skew 500 ppm
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:04.706471 22867 init.cc:377] Logged in from keytab as kudu/127.0.124.189@KRBTEST.COM (short username kudu)
I20260929 22:59:04.706976 22867 webserver.cc:460] Webserver started at http://127.0.124.189:34537/ using document root <none> and password file <none>
I20260929 22:59:04.707213 22867 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:04.707284 22867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:04.707487 22867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:04.708645 22867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data/instance:
uuid: "7e32ab1c5fd94b2d878d91b93fe128a4"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "cc3f1799e84ac2ab2f3a8b65d0f59122"
server_key_iv: "76d253b48b2e583612288d3d205cc2c9"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.709016 22867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal/instance:
uuid: "7e32ab1c5fd94b2d878d91b93fe128a4"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "cc3f1799e84ac2ab2f3a8b65d0f59122"
server_key_iv: "76d253b48b2e583612288d3d205cc2c9"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.710476 22867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:59:04.711295 22882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:04.711520 22867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:59:04.711623 22867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "7e32ab1c5fd94b2d878d91b93fe128a4"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "cc3f1799e84ac2ab2f3a8b65d0f59122"
server_key_iv: "76d253b48b2e583612288d3d205cc2c9"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.711705 22867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:04.712669 22860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } attempt: 2
I20260929 22:59:04.713027 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.712902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37026)
0929 22:59:04.712958 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.712996 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:59:04.713339 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.713250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37030)
0929 22:59:04.713293 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.713316 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:59:04.713421 22860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:45297: Network error: Client connection negotiation failed: client connection to 127.0.124.189:45297: connect: Connection refused (error 111)
I20260929 22:59:04.722970 22867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:04.725239 22867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:04.725392 22867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:04.729249 22867 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.189:45297
I20260929 22:59:04.729278 22934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.189:45297 every 8 connection(s)
I20260929 22:59:04.729606 22867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
I20260929 22:59:04.730458 22935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:04.731969 22935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:04.739030 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22867
I20260929 22:59:04.739120 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-1/wal/instance
I20260929 22:59:04.739370 498 external_mini_cluster.cc:1428] Setting key e6153db3c260e8810510a14ffadfbb08
I20260929 22:59:04.740728 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.732687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.0.124.190:33167)
0929 22:59:04.732762 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.732764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.732928 (+ 164us) server_negotiation.cc:407] Connection header received
0929 22:59:04.733375 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.733376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.733387 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.733439 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.733976 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.734535 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.735596 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.735791 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.735843 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.737970 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.737971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.737971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.737978 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.739280 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.739720 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.739721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.739722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.739779 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.740038 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.740039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.740040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.740159 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.740251 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.740558 (+ 307us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.740640 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:59:04.740919 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.732638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33167 (local address 127.0.0.1:47816)
0929 22:59:04.732816 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.732850 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.733294 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.733488 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.733492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.733722 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.733899 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.733903 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.734674 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.734675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.735513 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.735516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.735877 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.735878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.735984 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.736562 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.736570 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.737877 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.739353 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.739359 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.739361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.739639 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.739847 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.739848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.739848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.739970 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.740249 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.740257 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.740390 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.740497 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.740679 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260929 22:59:04.741469 22935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.188@KRBTEST.COM; defaulting to no policy
I20260929 22:59:04.748481 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.741717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37032)
0929 22:59:04.741779 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.741789 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.741824 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.742038 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.742040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.742197 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.742274 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.742276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.743134 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.743135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.743617 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.743618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.744102 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.744102 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.744165 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.744642 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.744646 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.745809 (+ 1163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.747439 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.747440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.747440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.747603 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.747822 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.747823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.747823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.747875 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.748156 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.748157 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.748242 (+ 85us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.748311 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.748417 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260929 22:59:04.748694 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.741802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37032 (local address 127.0.124.189:45297)
0929 22:59:04.741930 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.741934 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.741948 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:59:04.741961 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.741963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.741972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.742021 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.742357 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.742988 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.743717 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.744016 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.744092 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.745899 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.745906 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.745907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.745913 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.747366 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.747697 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.747700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.747700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.747755 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.747946 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.747947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.747947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.748085 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.748175 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.748366 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.748545 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260929 22:59:04.749258 22935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.749698 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.749572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53368)
0929 22:59:04.749630 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.749678 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.188@KRBTEST.COM" created.
W20260929 22:59:04.749825 22884 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
I20260929 22:59:04.750285 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.750190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53376)
0929 22:59:04.750242 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.750267 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:59:04.750408 22935 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:34983: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
I20260929 22:59:04.763121 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:34983
--webserver_interface=127.0.124.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:59:04.799659 22935 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } attempt: 1
I20260929 22:59:04.800197 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.800054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53390)
0929 22:59:04.800127 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.800170 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 22:59:04.800582 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.800501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53396)
0929 22:59:04.800543 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.800567 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:59:04.800700 22935 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:34983: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
I20260929 22:59:04.804622 22860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } attempt: 3
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:04.811511 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.804997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37046 (local address 127.0.124.189:45297)
0929 22:59:04.805051 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.805053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.805063 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:59:04.805132 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.805132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.805145 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.805219 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.805534 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.806041 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.806777 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.806985 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.807057 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.809078 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.809080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.809080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.809086 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.810485 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.810860 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.810860 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.810861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.810909 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.811094 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.811094 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.811095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.811193 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.811242 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.811394 (+ 152us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.811453 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:59:04.811553 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.804945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37046)
0929 22:59:04.804989 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.805004 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.805069 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.805224 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.805225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.805388 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.805455 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.805457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.806136 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.806137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.806702 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.806704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.807065 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.807066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.807145 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.807582 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.807592 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.809002 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.810575 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.810576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.810577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.810787 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.810971 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.810972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.810973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.811036 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.811252 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.811253 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.811301 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.811369 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.811459 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260929 22:59:04.812052 22860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.812378 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.812300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53402)
0929 22:59:04.812332 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.812360 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260929 22:59:04.812688 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.812584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53416)
0929 22:59:04.812639 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.812662 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:59:04.812769 22860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:34983: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
W20260929 22:59:04.843607 22942 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:04.843827 22942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:04.843859 22942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:04.843899 22942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260929 22:59:04.843914 22860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } attempt: 1
I20260929 22:59:04.844381 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.844253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53420)
0929 22:59:04.844318 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.844356 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 22:59:04.844760 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.844643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53434)
0929 22:59:04.844708 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.844736 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260929 22:59:04.844842 22860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:34983: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
W20260929 22:59:04.845429 22942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:04.845469 22942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:04.845484 22942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:04.845526 22942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:04.845544 22942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:04.847045 22942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:33167,127.0.124.189:45297,127.0.124.188:34983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:34983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.124.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:04.847292 22942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:04.847548 22942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:04.852259 22948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:04.852270 22950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:04.852293 22942 server_base.cc:1034] running on GCE node
W20260929 22:59:04.852270 22947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:04.852726 22942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:04.852998 22942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:04.854168 22942 hybrid_clock.cc:648] HybridClock initialized: now 1790722744854155 us; error 26 us; skew 500 ppm
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:04.856485 22942 init.cc:377] Logged in from keytab as kudu/127.0.124.188@KRBTEST.COM (short username kudu)
I20260929 22:59:04.856907 22942 webserver.cc:460] Webserver started at http://127.0.124.188:44065/ using document root <none> and password file <none>
I20260929 22:59:04.857095 22942 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:04.857134 22942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:04.857216 22942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:04.858237 22942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data/instance:
uuid: "986fc06c9fcb4a6ebb2684ff40405ecc"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "dc59db66873937d5d42bb854cf081c1a"
server_key_iv: "06dcf25ea0a18b8e434e81c06bd364eb"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.858513 22942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal/instance:
uuid: "986fc06c9fcb4a6ebb2684ff40405ecc"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "dc59db66873937d5d42bb854cf081c1a"
server_key_iv: "06dcf25ea0a18b8e434e81c06bd364eb"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.859674 22942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:59:04.860353 22957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:04.860502 22942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:04.860582 22942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "986fc06c9fcb4a6ebb2684ff40405ecc"
format_stamp: "Formatted at 2026-09-29 22:59:04 on dist-test-slave-512q"
server_key: "dc59db66873937d5d42bb854cf081c1a"
server_key_iv: "06dcf25ea0a18b8e434e81c06bd364eb"
server_key_version: "encryptionkey@0"
I20260929 22:59:04.860635 22942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:04.868835 22935 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } attempt: 2
I20260929 22:59:04.869199 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.869065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53436)
0929 22:59:04.869130 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.869166 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 22:59:04.869532 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.869453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53442)
0929 22:59:04.869493 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.869517 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 22:59:04.869644 22935 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:34983: Network error: Client connection negotiation failed: client connection to 127.0.124.188:34983: connect: Connection refused (error 111)
I20260929 22:59:04.878199 22942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:04.880440 22942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:04.880589 22942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:04.884199 22942 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.188:34983
I20260929 22:59:04.884305 23009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.188:34983 every 8 connection(s)
I20260929 22:59:04.884621 22942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
I20260929 22:59:04.885588 23010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:04.886938 23010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.887817 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 22942
I20260929 22:59:04.887940 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790722483574547-498-0/minicluster-data/master-2/wal/instance
I20260929 22:59:04.888159 498 external_mini_cluster.cc:1428] Setting key f673f14cad131dfffe01927ee5223630
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:04.896338 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.887541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47826 (local address 127.0.124.190:33167)
0929 22:59:04.887613 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.887615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.887859 (+ 244us) server_negotiation.cc:407] Connection header received
0929 22:59:04.888528 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.888529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.888542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.888580 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.889245 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.889957 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.891092 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.891275 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.891367 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.893741 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.893742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.893743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.893751 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.895003 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.895439 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.895440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.895441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.895499 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.895737 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.895738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.895739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.895871 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.895948 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.896183 (+ 235us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.896281 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:59:04.896581 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.887494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:33167 (local address 127.0.0.1:47826)
0929 22:59:04.887718 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.887767 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.888414 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.888678 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.888683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.889002 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.889156 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.889160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.890039 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.890040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.891008 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.891011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.891397 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.891398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.891507 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.891981 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.891991 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.893656 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.895065 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.895072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.895073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.895370 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.895580 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.895581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.895581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.895672 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.895941 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.895945 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.896042 (+ 97us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.896134 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.896307 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":41,"thread_start_us":102,"threads_started":1}
I20260929 22:59:04.897142 23010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.897472 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.888521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.0.124.188:34983)
0929 22:59:04.888684 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.888688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.888737 (+ 49us) server_negotiation.cc:407] Connection header received
0929 22:59:04.888795 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.888798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.888820 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.888903 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.889435 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.890442 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.891351 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.891704 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.891770 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.894243 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.894249 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.894249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.894255 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.896144 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.896544 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.896547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.896547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.896602 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.896801 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.896802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.896802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.896978 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.897100 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.897235 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.897332 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":111,"threads_started":1}
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:04.903724 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.897387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:45297 (local address 127.0.0.1:37050)
0929 22:59:04.897433 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.897442 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.897479 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.897755 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.897756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.897857 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.897882 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.897883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.898663 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.898664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.899152 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.899153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.899523 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.899524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.899582 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.899968 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.899971 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.901074 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.902724 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.902725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.902726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.902894 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.903120 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.903120 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.903120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.903187 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.903425 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.903426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.903467 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.903551 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.903636 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 22:59:04.903733 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.897464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37050 (local address 127.0.124.189:45297)
0929 22:59:04.897509 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.897511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.897519 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:59:04.897546 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.897547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.897558 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.897620 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.897969 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.898573 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.899233 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.899440 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.899523 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.901175 (+ 1652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.901176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.901177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.901183 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.902644 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.902982 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.902983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.902984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.903044 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.903251 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.903251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.903252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.903357 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.903433 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.903575 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.903649 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:59:04.904086 23010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:04.905546 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.898258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.0.124.190:33167)
0929 22:59:04.898290 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.898292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.898321 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:59:04.898338 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.898339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.898347 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.898392 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.898837 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.899269 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.900052 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.900294 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.900365 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.902817 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.902818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.902819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.902825 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.904581 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.904936 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.904937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.904937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.904984 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.905168 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.905169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.905169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.905255 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.905357 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.905443 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.905494 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:04.910885 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.904333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53456)
0929 22:59:04.904410 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.904419 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.904461 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.904581 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.904582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.904721 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.904746 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.904747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.905607 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.905608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.906292 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.906295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.906756 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.906757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.906792 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.907153 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.907158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.908411 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.909904 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.909905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.909905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.910140 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.910347 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.910348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.910348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.910410 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.910684 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.910685 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.910718 (+ 33us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.910771 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.910833 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260929 22:59:04.910974 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.904378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.0.124.188:34983)
0929 22:59:04.904405 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.904407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.904448 (+ 41us) server_negotiation.cc:407] Connection header received
0929 22:59:04.904516 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.904517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.904524 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.904567 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.904813 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.905519 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.906366 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.906686 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.906760 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.908488 (+ 1728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.908489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.908490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.908495 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.909826 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.910239 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.910240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.910240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.910284 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.910475 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.910476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.910476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.910612 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.910679 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.910820 (+ 141us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.910893 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:04.912415 23010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: Bootstrap starting.
I20260929 22:59:04.913416 23010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:04.913728 23010 log.cc:824] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:04.914460 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.906262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37056 (local address 127.0.124.189:45297)
0929 22:59:04.906292 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.906294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.906337 (+ 43us) server_negotiation.cc:407] Connection header received
0929 22:59:04.906404 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.906405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.906413 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.906446 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.907023 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.907707 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.908624 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.908889 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.908959 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.911528 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.911529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.911529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.911535 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.913255 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.913613 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.913614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.913615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.913674 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.913894 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.913895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.913896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.914027 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.914211 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.914281 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.914372 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:59:04.914592 23010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: No bootstrap required, opened a new log
I20260929 22:59:04.915823 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:59:04.916589 23010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.916720 23010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986fc06c9fcb4a6ebb2684ff40405ecc, State: Initialized, Role: FOLLOWER
I20260929 22:59:04.916798 23010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.917102 23010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:04.917066 23016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.917161 23016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.916982 22834 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2c51a66fcea44c5c993564af957ce5f0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47840
W20260929 22:59:04.918685 23027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:04.918742 23027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:04.919960 22860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } attempt: 2
I20260929 22:59:04.919015 22942 master_runner.cc:186] Error getting master registration for 127.0.124.190:33167: OK, instance_id { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" instance_seqno: 1790722744579309 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:59:04.921883 22942 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:04.927187 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.920245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53458)
0929 22:59:04.920292 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.920305 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.920355 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.920597 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.920598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.920763 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.920804 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.920806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.921656 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.921657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.922278 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.922280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.922754 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.922755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.922804 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.923230 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.923234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.924399 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.926109 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.926110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.926110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.926324 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.926525 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.926525 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.926526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.926584 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.926888 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.926889 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.926928 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.926992 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.927076 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 22:59:04.927217 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.920428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.0.124.188:34983)
0929 22:59:04.920489 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.920491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.920500 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:59:04.920518 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.920519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.920528 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.920587 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.920880 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.921567 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.922371 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.922671 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.922742 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.924481 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.924482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.924482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.924489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.926024 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.926396 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.926397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.926397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.926454 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.926649 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.926650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.926650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.926820 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.926889 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.927031 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.927110 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:59:04.928588 22860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: Bootstrap starting.
I20260929 22:59:04.929144 22860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:04.929410 22860 log.cc:824] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:04.930218 22860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: No bootstrap required, opened a new log
I20260929 22:59:04.931504 22860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.931651 22860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c51a66fcea44c5c993564af957ce5f0, State: Initialized, Role: FOLLOWER
I20260929 22:59:04.931731 22860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.932031 22860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:04.932008 23030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.932083 22834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 22:59:04.932128 23030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.932184 22834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:04.932894 22834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.933102 22834 leader_election.cc:288] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7e32ab1c5fd94b2d878d91b93fe128a4 (127.0.124.189:45297), 986fc06c9fcb4a6ebb2684ff40405ecc (127.0.124.188:34983)
W20260929 22:59:04.934019 23041 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:04.934155 23041 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:04.934469 22984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c51a66fcea44c5c993564af957ce5f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc"
I20260929 22:59:04.934605 22984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:04.935611 22984 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c51a66fcea44c5c993564af957ce5f0 in term 1.
I20260929 22:59:04.934508 22792 master_runner.cc:186] Error getting master registration for 127.0.124.189:45297: OK, instance_id { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" instance_seqno: 1790722744728065 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:59:04.936671 22792 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:59:04.936889 22809 leader_election.cc:302] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c51a66fcea44c5c993564af957ce5f0, 986fc06c9fcb4a6ebb2684ff40405ecc; no voters:
I20260929 22:59:04.937022 23030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:59:04.937175 23030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [term 1 LEADER]: Becoming Leader. State: Replica: 2c51a66fcea44c5c993564af957ce5f0, State: Running, Role: LEADER
I20260929 22:59:04.937289 23030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.937814 23050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c51a66fcea44c5c993564af957ce5f0. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.937908 23050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:04.938059 23052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:59:04.938232 23052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:59:04.949853 22984 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [term 1 FOLLOWER]: Refusing update from remote peer 2c51a66fcea44c5c993564af957ce5f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:59:04.950209 23050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:59:04.951422 23016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c51a66fcea44c5c993564af957ce5f0. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.951505 23016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.952700 23050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.952775 23050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:04.953080 23016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.953111 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.936798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37058 (local address 127.0.124.189:45297)
0929 22:59:04.936836 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.936838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.940567 (+ 3729us) server_negotiation.cc:407] Connection header received
0929 22:59:04.940660 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.940661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.940670 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.940700 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.941425 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.942153 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.943158 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.943984 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.944031 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.949444 (+ 5413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.949445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.949445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.949463 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.951222 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.952164 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.952165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.952166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.952254 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.952490 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.952491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.952491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.952627 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.952699 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.952915 (+ 216us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.952990 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:59:04.953161 23016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.953373 23053 mvcc.cc:205] Tried to move back new op lower bound from 7334800363312508928 to 7334800363264126976. Current Snapshot: MvccSnapshot[applied={T|T < 7334800363312508928}]
I20260929 22:59:04.953845 23054 mvcc.cc:205] Tried to move back new op lower bound from 7334800363312508928 to 7334800363264126976. Current Snapshot: MvccSnapshot[applied={T|T < 7334800363312508928}]
I20260929 22:59:04.954295 23052 catalog_manager.cc:1347] Generated new cluster ID: c6aa135f35c34e23802dab2875d79eee
I20260929 22:59:04.954337 23052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:59:04.959015 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.936749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53470 (local address 127.0.124.188:34983)
0929 22:59:04.936812 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.936814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.944482 (+ 7668us) server_negotiation.cc:407] Connection header received
0929 22:59:04.944525 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.944526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.944537 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.944597 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.945532 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.946241 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.947717 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.948016 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.948057 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.951313 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.951327 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.951327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.951333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.953001 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.956880 (+ 3879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.956881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.956881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.956948 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.957717 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.957718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.957718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.957878 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.957970 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.958853 (+ 883us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.958929 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:59:04.959826 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.934618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47852 (local address 127.0.124.190:33167)
0929 22:59:04.934662 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.934664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.940429 (+ 5765us) server_negotiation.cc:407] Connection header received
0929 22:59:04.940513 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.940514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.940524 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.940574 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.941702 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.942369 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.944006 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.944327 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.944372 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.954216 (+ 9844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.954218 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.954218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.954225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.956075 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.957328 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.957329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.957330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.957391 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.958319 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.958333 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.958333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.958457 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.958529 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.959666 (+ 1137us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.959741 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:59:04.960790 22935 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } attempt: 3
Sep 29 22:59:04 dist-test-slave-512q krb5kdc[22779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:04.970625 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.961005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:34983 (local address 127.0.0.1:53480)
0929 22:59:04.961074 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:04.961083 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:04.961114 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:04.961336 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:04.961337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:04.961474 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:04.961508 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.961510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.962345 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.962345 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.963121 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:04.963123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.963736 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.963737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:04.963818 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.965142 (+ 1324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:04.965147 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:04.966660 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:04.969330 (+ 2670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.969331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.969331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.969539 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.969822 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:04.969823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:04.969824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:04.969891 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:04.970333 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:04.970334 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:04.970389 (+ 55us) client_negotiation.cc:769] Sending connection context
0929 22:59:04.970445 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:59:04.970530 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260929 22:59:04.971395 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:04.961171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53480 (local address 127.0.124.188:34983)
0929 22:59:04.961216 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:04.961218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:04.961224 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:59:04.961242 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:04.961242 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:04.961250 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:04.961290 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:04.961579 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.962247 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.963206 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:04.963538 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:04.963604 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:04.966763 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:04.966764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:04.966764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:04.966770 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:04.969226 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.969624 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.969625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.969625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.969715 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:04.969968 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:04.969969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:04.969969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:04.970178 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:04.971012 (+ 834us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:04.971085 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 22:59:04.971215 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:59:04.972450 23052 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:59:04.973140 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: Bootstrap starting.
I20260929 22:59:04.973168 23052 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:59:04.973807 22935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:04.974083 22935 log.cc:824] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:04.980896 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: No bootstrap required, opened a new log
I20260929 22:59:04.982906 22935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.983037 22935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e32ab1c5fd94b2d878d91b93fe128a4, State: Initialized, Role: FOLLOWER
I20260929 22:59:04.983108 22935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } }
I20260929 22:59:04.983734 22908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:04.984643 22908 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [term 1 FOLLOWER]: Refusing update from remote peer 2c51a66fcea44c5c993564af957ce5f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:59:04.985015 22909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c51a66fcea44c5c993564af957ce5f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4"
I20260929 22:59:04.985050 23030 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:59:04.985792 22909 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c51a66fcea44c5c993564af957ce5f0 in term 1.
I20260929 22:59:04.983660 22935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:04.987165 23052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0: Generated new TSK 0
I20260929 22:59:04.987329 23052 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:59:04.988641 23075 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:04.988725 23075 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:04.988853 23061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.988924 23061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.988981 23061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c51a66fcea44c5c993564af957ce5f0. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.989037 23061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.989063 23061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:04.989106 23061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:04.989604 23062 mvcc.cc:205] Tried to move back new op lower bound from 7334800363455393792 to 7334800363264126976. Current Snapshot: MvccSnapshot[applied={T|T < 7334800363312508928}]
W20260929 22:59:05.015563 22863 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.013952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47866 (local address 127.0.124.190:33167)
0929 22:59:05.013996 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.013998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.014890 (+ 892us) server_negotiation.cc:407] Connection header received
0929 22:59:05.014997 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.014999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.015010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.015041 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.015483 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47866: BlockingRecv error: recv got EOF from 127.0.0.1:47866 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 22:59:05.016319 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.014349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37074 (local address 127.0.124.189:45297)
0929 22:59:05.014394 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.014396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.015814 (+ 1418us) server_negotiation.cc:407] Connection header received
0929 22:59:05.015906 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.015907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.015917 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.015945 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.016256 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37074: BlockingRecv error: recv got EOF from 127.0.0.1:37074 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260929 22:59:05.017023 23014 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.014653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53482 (local address 127.0.124.188:34983)
0929 22:59:05.014689 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.014690 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.016496 (+ 1806us) server_negotiation.cc:407] Connection header received
0929 22:59:05.016629 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.016630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.016640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.016670 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.016965 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53482: BlockingRecv error: recv got EOF from 127.0.0.1:53482 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:59:05.019315 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.018580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37086 (local address 127.0.124.189:45297)
0929 22:59:05.018613 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.018615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.018820 (+ 205us) server_negotiation.cc:407] Connection header received
0929 22:59:05.018915 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.018916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.018931 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.018959 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.019260 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37086: BlockingRecv error: recv got EOF from 127.0.0.1:37086 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 22:59:05.022231 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.021475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37088 (local address 127.0.124.189:45297)
0929 22:59:05.021505 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.021506 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.021769 (+ 263us) server_negotiation.cc:407] Connection header received
0929 22:59:05.021857 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.021857 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.021866 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.021894 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.022189 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37088: BlockingRecv error: recv got EOF from 127.0.0.1:37088 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:59:05.025910 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.025229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37102 (local address 127.0.124.189:45297)
0929 22:59:05.025258 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.025259 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.025450 (+ 191us) server_negotiation.cc:407] Connection header received
0929 22:59:05.025533 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.025534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.025542 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.025582 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.025872 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37102: BlockingRecv error: recv got EOF from 127.0.0.1:37102 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260929 22:59:05.031658 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.030976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37110 (local address 127.0.124.189:45297)
0929 22:59:05.031006 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.031008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.031202 (+ 194us) server_negotiation.cc:407] Connection header received
0929 22:59:05.031290 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.031291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.031299 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.031327 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.031620 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37110: BlockingRecv error: recv got EOF from 127.0.0.1:37110 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:59:05.041494 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.040768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37112 (local address 127.0.124.189:45297)
0929 22:59:05.040801 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.040802 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.041016 (+ 214us) server_negotiation.cc:407] Connection header received
0929 22:59:05.041107 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.041108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.041118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.041147 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.041443 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37112: BlockingRecv error: recv got EOF from 127.0.0.1:37112 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:59:05.059427 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.058646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37114 (local address 127.0.124.189:45297)
0929 22:59:05.058685 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.058687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.058933 (+ 246us) server_negotiation.cc:407] Connection header received
0929 22:59:05.059026 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.059027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.059037 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.059064 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.059377 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37114: BlockingRecv error: recv got EOF from 127.0.0.1:37114 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:59:05.093794 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.092829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37126 (local address 127.0.124.189:45297)
0929 22:59:05.092872 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.092874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.093165 (+ 291us) server_negotiation.cc:407] Connection header received
0929 22:59:05.093272 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.093273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.093285 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.093317 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.093736 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37126: BlockingRecv error: recv got EOF from 127.0.0.1:37126 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:59:05.160064 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.159223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37140 (local address 127.0.124.189:45297)
0929 22:59:05.159306 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.159308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.159419 (+ 111us) server_negotiation.cc:407] Connection header received
0929 22:59:05.159534 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.159535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.159549 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.159645 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.160000 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37140: BlockingRecv error: recv got EOF from 127.0.0.1:37140 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260929 22:59:05.290010 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.289268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.0.124.189:45297)
0929 22:59:05.289369 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.289371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.289385 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:59:05.289464 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.289465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.289478 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.289551 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.289917 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37152: BlockingRecv error: recv got EOF from 127.0.0.1:37152 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260929 22:59:05.416706 23030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c51a66fcea44c5c993564af957ce5f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c51a66fcea44c5c993564af957ce5f0" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 33167 } } peers { permanent_uuid: "7e32ab1c5fd94b2d878d91b93fe128a4" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 45297 } } peers { permanent_uuid: "986fc06c9fcb4a6ebb2684ff40405ecc" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 34983 } } }
I20260929 22:59:05.416860 23030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c51a66fcea44c5c993564af957ce5f0 [sys.catalog]: This master's current role is: LEADER
W20260929 22:59:05.547713 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:05.547116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37156 (local address 127.0.124.189:45297)
0929 22:59:05.547184 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:05.547186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:05.547243 (+ 57us) server_negotiation.cc:407] Connection header received
0929 22:59:05.547285 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:05.547286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:05.547296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:05.547359 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:05.547667 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37156: BlockingRecv error: recv got EOF from 127.0.0.1:37156 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:59:05.919162 23027 catalog_manager.cc:1259] Loaded cluster ID: c6aa135f35c34e23802dab2875d79eee
I20260929 22:59:05.919227 23027 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: loading cluster ID for follower catalog manager: success
I20260929 22:59:05.919977 23027 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: acquiring CA information for follower catalog manager: success
I20260929 22:59:05.920251 23027 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 986fc06c9fcb4a6ebb2684ff40405ecc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:59:05.989113 23075 catalog_manager.cc:1259] Loaded cluster ID: c6aa135f35c34e23802dab2875d79eee
I20260929 22:59:05.989185 23075 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: loading cluster ID for follower catalog manager: success
I20260929 22:59:05.989980 23075 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: acquiring CA information for follower catalog manager: success
I20260929 22:59:05.990310 23075 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e32ab1c5fd94b2d878d91b93fe128a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:59:06.063236 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:06.060854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37160 (local address 127.0.124.189:45297)
0929 22:59:06.060970 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:06.060972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:06.061014 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:59:06.061058 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:06.061059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:06.061107 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:06.061201 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:06.061330 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.061812 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.062514 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.062692 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.062748 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:06.062875 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:06.062974 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:06.063030 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:06.063060 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 22:59:06.063076 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":65,"threads_started":1}
I20260929 22:59:06.067471 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:06.065043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.0.124.188:34983)
0929 22:59:06.065159 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:06.065161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:06.065172 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:59:06.065262 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:06.065262 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:06.065311 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:06.065388 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:06.065507 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.065963 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.066651 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.066860 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.066948 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:06.067135 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:06.067237 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:06.067313 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:06.067365 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:59:06.067386 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":50,"threads_started":1}
I20260929 22:59:06.071645 23157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:06.068894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47868 (local address 127.0.124.190:33167)
0929 22:59:06.069166 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:06.069168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:06.069176 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:59:06.069220 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:06.069221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:06.069272 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:06.069363 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:06.069550 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.070019 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.070804 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.071050 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.071113 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:06.071280 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:06.071391 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:06.071449 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:06.071503 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:59:06.071524 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":59,"threads_started":1}
I20260929 22:59:06.071765 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:06.069166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.0.124.188:34983)
0929 22:59:06.069226 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:06.069228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:06.069236 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:59:06.069291 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:06.069291 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:06.069300 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:06.069361 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:06.069522 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.069946 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.071026 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.071317 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.071393 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:06.071539 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:06.071568 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:06.071605 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:06.071685 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 22:59:06.071708 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:59:06.072655 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:06.068907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.0.124.189:45297)
0929 22:59:06.068943 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:06.068945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:06.069264 (+ 319us) server_negotiation.cc:407] Connection header received
0929 22:59:06.069387 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:06.069388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:06.069398 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:06.069448 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:06.070050 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.070779 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.071908 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:06.072154 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:06.072233 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:06.072375 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:06.072423 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:06.072505 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:06.072562 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:59:06.072588 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:59:06.073515 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22792
I20260929 22:59:06.078773 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22867
I20260929 22:59:06.083498 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 22942
2026-09-29T22:59:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2781 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:59:06 dist-test-slave-512q krb5kdc[23161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:59:06 dist-test-slave-512q krb5kdc[23161](info): set up 2 sockets
Sep 29 22:59:06 dist-test-slave-512q krb5kdc[23161](info): commencing operation
krb5kdc: starting...
W20260929 22:59:07.114609 498 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/test-user.keytab.
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:59:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:59:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.124.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
Entry for principal kudu/127.0.124.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab.
I20260929 22:59:07.229300 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34309
--webserver_interface=127.0.124.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:59:07.309150 23174 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:07.309370 23174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:07.309398 23174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:07.309439 23174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:07.310549 23174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:07.310611 23174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:07.310644 23174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:07.310691 23174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:07.310720 23174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:07.312196 23174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.190.keytab
--principal=kudu/127.0.124.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.190:34309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.124.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:07.312505 23174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:07.312755 23174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:07.317647 23182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.317648 23180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.317677 23179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:07.317768 23174 server_base.cc:1034] running on GCE node
I20260929 22:59:07.318121 23174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:07.318331 23174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:07.319463 23174 hybrid_clock.cc:648] HybridClock initialized: now 1790722747319456 us; error 30 us; skew 500 ppm
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:07.325632 23174 init.cc:377] Logged in from keytab as kudu/127.0.124.190@KRBTEST.COM (short username kudu)
I20260929 22:59:07.325986 23174 webserver.cc:460] Webserver started at http://127.0.124.190:43285/ using document root <none> and password file <none>
I20260929 22:59:07.326160 23174 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:07.326198 23174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:07.326282 23174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:07.327210 23174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data/instance:
uuid: "5d50dcec2e1a40ed939568c9c51e0694"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "6d8605fe50464e6c8404bb3ce9a74a37"
server_key_iv: "a6adee622d063965d5b7b46eefdc9d55"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.327486 23174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance:
uuid: "5d50dcec2e1a40ed939568c9c51e0694"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "6d8605fe50464e6c8404bb3ce9a74a37"
server_key_iv: "a6adee622d063965d5b7b46eefdc9d55"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.328814 23174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:59:07.329499 23189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:07.329705 23174 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:59:07.329803 23174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal
uuid: "5d50dcec2e1a40ed939568c9c51e0694"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "6d8605fe50464e6c8404bb3ce9a74a37"
server_key_iv: "a6adee622d063965d5b7b46eefdc9d55"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.329879 23174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:07.363153 23174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:07.365630 23174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:07.365803 23174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:07.369683 23174 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.190:34309
I20260929 22:59:07.369719 23241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.190:34309 every 8 connection(s)
I20260929 22:59:07.370078 23174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/data/info.pb
I20260929 22:59:07.371054 23242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:07.372627 23242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:07.374161 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 23174
I20260929 22:59:07.374264 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-0/wal/instance
I20260929 22:59:07.374439 498 external_mini_cluster.cc:1428] Setting key 47ac2fd47a6c6446ae2e9116c38d601d
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.124.189@KRBTEST.COM; defaulting to no policy
I20260929 22:59:07.383358 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.373263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34309 (local address 127.0.0.1:36860)
0929 22:59:07.373440 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.373481 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.373927 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.374262 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.374265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.374599 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.374750 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.374755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.376175 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.376176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.377328 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.377331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.377820 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.377822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.377906 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.378380 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.378391 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.379904 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.381917 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.381923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.381924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.382106 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.382375 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.382375 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.382376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.382451 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.382899 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.382904 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.382960 (+ 56us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.383037 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.383167 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260929 22:59:07.383361 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.373338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.0.124.190:34309)
0929 22:59:07.373488 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.373491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.373577 (+ 86us) server_negotiation.cc:407] Connection header received
0929 22:59:07.374078 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.374080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.374105 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.374227 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.374853 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.376083 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.377412 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.377715 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.377793 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.379987 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.379995 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.379996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.380004 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.381837 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.382194 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.382197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.382197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.382302 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.382515 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.382516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.382516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.382811 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.382904 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.383098 (+ 194us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.383225 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260929 22:59:07.384308 23242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:07.384625 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.384525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42230)
0929 22:59:07.384569 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.384609 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 22:59:07.384907 23191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
I20260929 22:59:07.385396 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.385316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42240)
0929 22:59:07.385358 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.385382 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:59:07.385494 23242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:33877: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
Entry for principal kudu/127.0.124.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab.
I20260929 22:59:07.399237 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:33877
--webserver_interface=127.0.124.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:59:07.434703 23242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } attempt: 1
I20260929 22:59:07.435236 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.435096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42250)
0929 22:59:07.435165 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.435207 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260929 22:59:07.435650 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.435523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42254)
0929 22:59:07.435593 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.435626 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260929 22:59:07.435796 23242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:33877: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
W20260929 22:59:07.479525 23249 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:07.479780 23249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:07.479809 23249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:07.479853 23249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:07.480966 23249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:07.481033 23249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:07.481058 23249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:07.481078 23249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:07.481110 23249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:07.482542 23249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.189.keytab
--principal=kudu/127.0.124.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.189:33877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.124.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:07.482823 23249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:07.483042 23249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:07.487877 23254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.487852 23257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.487901 23255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:07.488138 23249 server_base.cc:1034] running on GCE node
I20260929 22:59:07.488381 23249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:07.488619 23249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:07.489754 23249 hybrid_clock.cc:648] HybridClock initialized: now 1790722747489742 us; error 27 us; skew 500 ppm
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:07.492098 23249 init.cc:377] Logged in from keytab as kudu/127.0.124.189@KRBTEST.COM (short username kudu)
I20260929 22:59:07.492579 23249 webserver.cc:460] Webserver started at http://127.0.124.189:40297/ using document root <none> and password file <none>
I20260929 22:59:07.492794 23249 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:07.492837 23249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:07.492976 23249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:07.494002 23249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data/instance:
uuid: "2177bbed49f34bc6bddbd72ac819d583"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "5c263ebfe1beb4be3c8def7e6d3035ae"
server_key_iv: "17890dab4a9ad0961440daacdf8fd28a"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.494369 23249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal/instance:
uuid: "2177bbed49f34bc6bddbd72ac819d583"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "5c263ebfe1beb4be3c8def7e6d3035ae"
server_key_iv: "17890dab4a9ad0961440daacdf8fd28a"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.495631 23249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:59:07.496325 23264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:07.496490 23249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:59:07.496558 23249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal
uuid: "2177bbed49f34bc6bddbd72ac819d583"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "5c263ebfe1beb4be3c8def7e6d3035ae"
server_key_iv: "17890dab4a9ad0961440daacdf8fd28a"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.496657 23249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:07.503928 23242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } attempt: 2
I20260929 22:59:07.504310 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.504182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42264)
0929 22:59:07.504246 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.504283 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 22:59:07.504647 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.504566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42272)
0929 22:59:07.504607 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.504631 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 22:59:07.504752 23242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.189:33877: Network error: Client connection negotiation failed: client connection to 127.0.124.189:33877: connect: Connection refused (error 111)
I20260929 22:59:07.509668 23249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:07.511337 23249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:07.511497 23249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:07.515591 23249 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.189:33877
I20260929 22:59:07.515614 23316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.189:33877 every 8 connection(s)
I20260929 22:59:07.515954 23249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/data/info.pb
I20260929 22:59:07.516927 23317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:07.518385 23317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:07.523790 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 23249
I20260929 22:59:07.523890 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-1/wal/instance
I20260929 22:59:07.524078 498 external_mini_cluster.cc:1428] Setting key 760c1495cb949e9416a7c554471a1f84
I20260929 22:59:07.526863 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.519029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.0.124.190:34309)
0929 22:59:07.519111 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.519113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.519272 (+ 159us) server_negotiation.cc:407] Connection header received
0929 22:59:07.519695 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.519696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.519709 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.519758 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.520350 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.520830 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.521735 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.521923 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.521974 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.524077 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.524078 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.524079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.524086 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.525465 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.525882 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.525883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.525884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.525946 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.526197 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.526198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.526198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.526332 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.526403 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.526689 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.526774 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:59:07.527036 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.518990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34309 (local address 127.0.0.1:36866)
0929 22:59:07.519164 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.519197 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.519609 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.519808 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.519811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.520035 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.520278 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.520282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.520903 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.520903 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.521664 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.521666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.522004 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.522004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.522102 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.522617 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.522624 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.523995 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.525565 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.525573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.525575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.525791 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.526014 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.526015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.526015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.526126 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.526406 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.526413 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.526546 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.526665 (+ 119us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.526813 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260929 22:59:07.528676 23317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.0.124.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.124.188@KRBTEST.COM" created.
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:07.538476 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.528970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42286)
0929 22:59:07.529036 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.529046 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.529084 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.529335 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.529336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.529496 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.529556 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.529558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.530395 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.530396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.531249 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.531251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.531705 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.531706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.531796 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.532156 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.532161 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.535721 (+ 3560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.537433 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.537434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.537434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.537586 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.537831 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.537832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.537832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.537889 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.538197 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.538198 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.538235 (+ 37us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.538311 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.538408 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 22:59:07.538653 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.529033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42286 (local address 127.0.124.189:33877)
0929 22:59:07.529185 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.529190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.529207 (+ 17us) server_negotiation.cc:407] Connection header received
0929 22:59:07.529234 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.529236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.529246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.529307 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.529644 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.530308 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.531337 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.531621 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.531678 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.535800 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.535807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.535808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.535813 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.537359 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.537698 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.537702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.537702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.537764 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.537954 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.537955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.537955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.538120 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.538219 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.538382 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.538475 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260929 22:59:07.539232 23317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:07.539587 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.539465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32912)
0929 22:59:07.539515 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.539559 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:59:07.539763 23268 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
I20260929 22:59:07.540207 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.540099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32922)
0929 22:59:07.540152 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.540175 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260929 22:59:07.540333 23317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:39201: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
Entry for principal kudu/127.0.124.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab.
I20260929 22:59:07.548827 498 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ2hK39/build/release/bin/kudu
/tmp/dist-test-taskZ2hK39/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:39201
--webserver_interface=127.0.124.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.124.148:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:59:07.589552 23317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } attempt: 1
I20260929 22:59:07.590143 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.589975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32928)
0929 22:59:07.590042 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.590106 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260929 22:59:07.590652 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.590502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32942)
0929 22:59:07.590566 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.590590 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260929 22:59:07.590744 23317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:39201: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
I20260929 22:59:07.595886 23242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } attempt: 3
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:07.602818 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.596254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42300 (local address 127.0.124.189:33877)
0929 22:59:07.596294 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.596296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.596307 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:59:07.596374 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.596375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.596386 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.596439 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.596842 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.597363 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.598079 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.598333 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.598424 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.600420 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.600421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.600422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.600429 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.601694 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.602034 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.602035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.602036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.602089 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.602284 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.602285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.602285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.602392 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.602467 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.602657 (+ 190us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.602730 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:59:07.602828 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.596181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42300)
0929 22:59:07.596249 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.596259 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.596311 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.596445 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.596446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.596645 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.596706 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.596708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.597451 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.597453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.597992 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.597993 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.598422 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.598423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.598504 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.599016 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.599021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.600337 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.601787 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.601788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.601789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.601956 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.602156 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.602156 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.602157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.602213 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.602460 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.602461 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.602546 (+ 85us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.602615 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.602737 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260929 22:59:07.603444 23242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:07.603778 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.603698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32956)
0929 22:59:07.603728 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.603757 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260929 22:59:07.604115 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.604034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32960)
0929 22:59:07.604080 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.604101 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:59:07.604241 23242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:39201: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
W20260929 22:59:07.632642 23324 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:59:07.632831 23324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:59:07.632848 23324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:59:07.632867 23324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:59:07.634099 23324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:59:07.634140 23324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:59:07.634153 23324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:59:07.634189 23324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:59:07.634215 23324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:59:07.635406 23242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } attempt: 1
I20260929 22:59:07.635834 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.635696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32962)
0929 22:59:07.635767 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.635805 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 22:59:07.635872 23324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.124.148:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.124.190:34309,127.0.124.189:33877,127.0.124.188:39201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/krb5kdc/kudu_127.0.124.188.keytab
--principal=kudu/127.0.124.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.124.188:39201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.124.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:59:07.636157 23324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:59:07.636251 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.636112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32976)
0929 22:59:07.636165 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.636190 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260929 22:59:07.636405 23242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:39201: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
I20260929 22:59:07.636444 23324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:59:07.640926 23332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.640937 23330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:59:07.640954 23329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:59:07.641141 23324 server_base.cc:1034] running on GCE node
I20260929 22:59:07.641532 23324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:59:07.641778 23324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:59:07.642935 23324 hybrid_clock.cc:648] HybridClock initialized: now 1790722747642904 us; error 46 us; skew 500 ppm
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:59:07.645670 23324 init.cc:377] Logged in from keytab as kudu/127.0.124.188@KRBTEST.COM (short username kudu)
I20260929 22:59:07.646163 23324 webserver.cc:460] Webserver started at http://127.0.124.188:43619/ using document root <none> and password file <none>
I20260929 22:59:07.646390 23324 fs_manager.cc:359] Metadata directory not provided
I20260929 22:59:07.646441 23324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:59:07.646620 23324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:59:07.647660 23324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data/instance:
uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "94bf7e3a35e285d08ae3f9b5325e98d0"
server_key_iv: "8f6baac3e717c514ecb4b987b393b738"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.648069 23324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal/instance:
uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "94bf7e3a35e285d08ae3f9b5325e98d0"
server_key_iv: "8f6baac3e717c514ecb4b987b393b738"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.649451 23324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:59:07.650170 23339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:59:07.650386 23324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:59:07.650480 23324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal
uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a"
format_stamp: "Formatted at 2026-09-29 22:59:07 on dist-test-slave-512q"
server_key: "94bf7e3a35e285d08ae3f9b5325e98d0"
server_key_iv: "8f6baac3e717c514ecb4b987b393b738"
server_key_version: "encryptionkey@0"
I20260929 22:59:07.650550 23324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:59:07.658886 23317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } attempt: 2
I20260929 22:59:07.659258 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.659143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32980)
0929 22:59:07.659199 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.659234 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:59:07.659652 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.659533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:32982)
0929 22:59:07.659586 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.659623 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:59:07.659798 23317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.124.188:39201: Network error: Client connection negotiation failed: client connection to 127.0.124.188:39201: connect: Connection refused (error 111)
I20260929 22:59:07.679302 23324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:59:07.681751 23324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:59:07.681927 23324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:59:07.686159 23324 rpc_server.cc:307] RPC server started. Bound to: 127.0.124.188:39201
I20260929 22:59:07.686189 23391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.124.188:39201 every 8 connection(s)
I20260929 22:59:07.686558 23324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/data/info.pb
I20260929 22:59:07.687551 23392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:59:07.689098 23392 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:59:07.693995 498 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ2hK39/build/release/bin/kudu as pid 23324
I20260929 22:59:07.694118 498 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ2hK39/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790722483574547-498-0/minicluster-data/master-2/wal/instance
I20260929 22:59:07.694321 498 external_mini_cluster.cc:1428] Setting key be9554101fc8affaa0c9d39f1874b2fa
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
I20260929 22:59:07.697851 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.689748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36870 (local address 127.0.124.190:34309)
0929 22:59:07.689824 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.689826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.689975 (+ 149us) server_negotiation.cc:407] Connection header received
0929 22:59:07.690410 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.690411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.690421 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.690472 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.691009 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.691461 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.692443 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.692629 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.692682 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.694970 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.694971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.694972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.694978 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.696509 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.696897 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.696898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.696898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.696961 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.697196 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.697197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.697197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.697329 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.697407 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.697683 (+ 276us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.697762 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:59:07.698031 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.689702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.190:34309 (local address 127.0.0.1:36870)
0929 22:59:07.689865 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.689898 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.690331 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.690533 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.690536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.690761 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.690941 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.690944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.691534 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.691535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.692377 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.692379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.692706 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.692707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.692832 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.693257 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.693264 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.694868 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.696585 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.696591 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.696592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.696826 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.697013 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.697013 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.697014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.697124 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.697399 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.697405 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.697537 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.697659 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.697806 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260929 22:59:07.698591 23392 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:07.703527 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.694669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.0.124.188:39201)
0929 22:59:07.694833 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.694837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.694885 (+ 48us) server_negotiation.cc:407] Connection header received
0929 22:59:07.694957 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.694960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.694972 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.695061 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.695820 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.696886 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.697633 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.697982 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.698048 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.700692 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.700699 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.700700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.700706 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.702286 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.702654 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.702657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.702657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.702710 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.702945 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.702946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.702946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.703113 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.703269 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.703363 (+ 94us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.703436 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260929 22:59:07.705468 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.698846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.189:33877 (local address 127.0.0.1:42310)
0929 22:59:07.698914 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.698924 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.698961 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.699117 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.699118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.699289 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.699330 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.699332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.700069 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.700070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.700679 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.700681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.701157 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.701158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.701215 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.701602 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.701606 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.702726 (+ 1120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.704526 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.704526 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.704527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.704754 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.704939 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.704940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.704940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.705009 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.705269 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.705269 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.705298 (+ 29us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.705346 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.705410 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260929 22:59:07.705528 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.698916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.0.124.189:33877)
0929 22:59:07.698967 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.698969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.698983 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:59:07.699013 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.699014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.699024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.699118 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.699402 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.699982 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.700736 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.701052 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.701144 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.702810 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.702811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.702811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.702818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.704458 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.704827 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.704828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.704828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.704876 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.705077 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.705077 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.705078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.705205 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.705276 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.705368 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.705437 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:59:07.705971 23392 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.190@KRBTEST.COM
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.188@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:07.711565 23242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } attempt: 2
I20260929 22:59:07.711649 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.704296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.0.124.190:34309)
0929 22:59:07.704350 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.704352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.704360 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:59:07.704380 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.704381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.704389 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.704446 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.705017 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.705697 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.706598 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.706770 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.706818 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.709096 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.709098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.709098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.709105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.710447 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.710815 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.710816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.710816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.710872 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.711104 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.711104 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.711104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.711202 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.711309 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.711427 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.711480 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:59:07.712910 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.706200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:33002)
0929 22:59:07.706254 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.706262 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.706293 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.706402 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.706403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.706533 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.706566 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.706567 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.707365 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.707366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.707814 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.707815 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.708295 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.708296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.708357 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.708679 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.708684 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.709970 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.711873 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.711874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.711874 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.712043 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.712271 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.712272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.712273 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.712328 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.712592 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.712593 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.712628 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.712707 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.712800 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260929 22:59:07.712962 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.706245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33002 (local address 127.0.124.188:39201)
0929 22:59:07.706277 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.706279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.706286 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:59:07.706345 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.706345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.706352 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.706391 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.706638 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.707299 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.707905 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.708197 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.708297 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.710051 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.710052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.710052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.710058 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.711798 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.712112 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.712114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.712114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.712181 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.712397 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.712397 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.712398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.712520 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.712574 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.712729 (+ 155us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.712848 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":16}
I20260929 22:59:07.714874 23392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: Bootstrap starting.
I20260929 22:59:07.715562 23392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:07.715902 23392 log.cc:824] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:07.716660 23392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: No bootstrap required, opened a new log
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.190@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.124.189@KRBTEST.COM
I20260929 22:59:07.718955 23392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.719123 23392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98f4cd9a157b4cb68ba2cfe0362c4a7a, State: Initialized, Role: FOLLOWER
I20260929 22:59:07.719213 23392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.719516 23392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:07.719470 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.719588 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.720064 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.711810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:33006)
0929 22:59:07.711945 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.711955 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.711993 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.712379 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.712380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.712535 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.712586 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.712587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.713911 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.713912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.714690 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.714692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.715178 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.715179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.715239 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.715575 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.715581 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.717014 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.718938 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.718939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.718940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.719096 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.719387 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.719388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.719388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.719452 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.719765 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.719766 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.719807 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.719874 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.719969 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260929 22:59:07.720086 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.712064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33006 (local address 127.0.124.188:39201)
0929 22:59:07.712241 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.712243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.712249 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:59:07.712267 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.712268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.712278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.712658 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.712715 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.713831 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.714769 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.715094 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.715167 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.717120 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.717121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.717121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.717128 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.718682 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.719193 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.719194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.719195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.719253 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.719530 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.719531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.719531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.719687 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.719758 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.719912 (+ 154us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.719982 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260929 22:59:07.721717 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.712368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42314 (local address 127.0.124.189:33877)
0929 22:59:07.712406 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.712408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.712415 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:59:07.712460 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.712461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.712470 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.712523 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.713121 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.713717 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.714680 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.714934 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.715012 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.717986 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.717987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.717987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.717996 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.719832 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.720694 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.720695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.720696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.720759 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.720973 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.720974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.720974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.721103 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.721275 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.721546 (+ 271us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.721622 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:59:07.721874 23242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: Bootstrap starting.
I20260929 22:59:07.722385 23242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:07.722609 23242 log.cc:824] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:07.723278 23242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: No bootstrap required, opened a new log
I20260929 22:59:07.724244 498 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:59:07.725162 23216 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5d50dcec2e1a40ed939568c9c51e0694"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36886
W20260929 22:59:07.721336 23410 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:07.725450 23410 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:07.725666 23242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.725793 23242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d50dcec2e1a40ed939568c9c51e0694, State: Initialized, Role: FOLLOWER
I20260929 22:59:07.725865 23242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.726212 23216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 22:59:07.726156 23413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.726289 23216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:07.726387 23413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.724431 23324 master_runner.cc:186] Error getting master registration for 127.0.124.190:34309: OK, instance_id { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" instance_seqno: 1790722747368534 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:59:07.726725 23324 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:59:07.727065 23216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.727277 23216 leader_election.cc:288] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [CANDIDATE]: Term 1 election: Requested vote from peers 2177bbed49f34bc6bddbd72ac819d583 (127.0.124.189:33877), 98f4cd9a157b4cb68ba2cfe0362c4a7a (127.0.124.188:39201)
I20260929 22:59:07.727494 23366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d50dcec2e1a40ed939568c9c51e0694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a"
I20260929 22:59:07.727586 23366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:07.726174 23242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:07.728451 23366 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d50dcec2e1a40ed939568c9c51e0694 in term 1.
I20260929 22:59:07.728673 23193 leader_election.cc:302] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d50dcec2e1a40ed939568c9c51e0694, 98f4cd9a157b4cb68ba2cfe0362c4a7a; no voters:
I20260929 22:59:07.728796 23413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:59:07.728948 23413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [term 1 LEADER]: Becoming Leader. State: Replica: 5d50dcec2e1a40ed939568c9c51e0694, State: Running, Role: LEADER
I20260929 22:59:07.729030 23413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.729393 23413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d50dcec2e1a40ed939568c9c51e0694. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.729468 23413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: This master's current role is: LEADER
W20260929 22:59:07.730130 23431 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:07.730194 23431 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:07.730871 23174 master_runner.cc:186] Error getting master registration for 127.0.124.189:33877: OK, instance_id { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" instance_seqno: 1790722747514474 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:59:07.733090 23174 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:59:07.745002 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.736437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36892 (local address 127.0.124.190:34309)
0929 22:59:07.736489 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.736491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.736881 (+ 390us) server_negotiation.cc:407] Connection header received
0929 22:59:07.737017 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.737018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.737028 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.737094 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.737777 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.738232 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.739231 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.739428 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.739523 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.741031 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.741032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.741033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.741039 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.742860 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.743423 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.743424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.743424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.743495 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.744048 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.744049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.744050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.744192 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.744568 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.744809 (+ 241us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.744886 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:59:07.744987 23428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:59:07.745585 23428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:59:07.747772 23366 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [term 1 FOLLOWER]: Refusing update from remote peer 5d50dcec2e1a40ed939568c9c51e0694: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:59:07.748147 23420 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:59:07.749106 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.736532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33012 (local address 127.0.124.188:39201)
0929 22:59:07.736577 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.736579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.740374 (+ 3795us) server_negotiation.cc:407] Connection header received
0929 22:59:07.740472 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.740473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.740494 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.740524 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.741142 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.741935 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.743024 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.743374 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.743417 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.745683 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.745684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.745685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.745692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.747317 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.748231 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.748232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.748232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.748290 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.748509 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.748510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.748510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.748653 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.748726 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.748949 (+ 223us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.749031 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:59:07.749990 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d50dcec2e1a40ed939568c9c51e0694. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.750051 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.750902 23317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } attempt: 3
I20260929 22:59:07.752276 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.736635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42330 (local address 127.0.124.189:33877)
0929 22:59:07.736683 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.736685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.741219 (+ 4534us) server_negotiation.cc:407] Connection header received
0929 22:59:07.741323 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.741324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.741334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.741363 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.741991 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.742709 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.743704 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.743998 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.744036 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.747122 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.747123 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.747124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.747130 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.749172 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.749797 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.749798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.749798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.749858 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.751704 (+ 1846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.751705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.751706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.751824 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.751886 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.752083 (+ 197us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.752157 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Sep 29 22:59:07 dist-test-slave-512q krb5kdc[23161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.124.189@KRBTEST.COM for kudu/127.0.124.188@KRBTEST.COM
I20260929 22:59:07.757718 23413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.757803 23413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:07.758272 23437 mvcc.cc:205] Tried to move back new op lower bound from 7334800374770937856 to 7334800374698754048. Current Snapshot: MvccSnapshot[applied={T|T < 7334800374770937856}]
I20260929 22:59:07.758742 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.758807 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.759353 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.751170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.0.124.188:39201)
0929 22:59:07.751213 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.751214 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.751222 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:59:07.751264 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.751265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.751273 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.751320 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.751572 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.752293 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.753275 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.753564 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.753636 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.755660 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:59:07.755661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:59:07.755662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:59:07.755667 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:59:07.757306 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.757659 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.757660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.757660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.757714 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:59:07.758878 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:59:07.758880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:59:07.758880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:59:07.759000 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:59:07.759068 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:07.759210 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:59:07.759275 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260929 22:59:07.759357 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:07.751123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.124.188:39201 (local address 127.0.0.1:33022)
0929 22:59:07.751167 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:59:07.751178 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:59:07.751214 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:59:07.751322 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:59:07.751323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:59:07.751469 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:59:07.751505 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.751506 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.752383 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.752385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.753164 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:59:07.753166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:59:07.753640 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:59:07.753642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:59:07.753709 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:07.754181 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:59:07.754187 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:59:07.755577 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:59:07.757394 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.757395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.757396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.757580 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.757782 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:59:07.757783 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:59:07.757783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:59:07.757839 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:59:07.759073 (+ 1234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:59:07.759074 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:59:07.759117 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:59:07.759189 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:59:07.759275 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:59:07.759117 23436 mvcc.cc:205] Tried to move back new op lower bound from 7334800374770937856 to 7334800374698754048. Current Snapshot: MvccSnapshot[applied={T|T < 7334800374770937856}]
I20260929 22:59:07.760923 23317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: Bootstrap starting.
I20260929 22:59:07.761520 23317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: Neither blocks nor log segments found. Creating new log.
I20260929 22:59:07.761811 23317 log.cc:824] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: Log is configured to *not* fsync() on all Append() calls
I20260929 22:59:07.764597 23428 catalog_manager.cc:1347] Generated new cluster ID: 0b443960e15d4f87936f968b4753e971
I20260929 22:59:07.764645 23428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:59:07.772897 23317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: No bootstrap required, opened a new log
I20260929 22:59:07.774718 23317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.774843 23317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2177bbed49f34bc6bddbd72ac819d583, State: Initialized, Role: FOLLOWER
I20260929 22:59:07.774924 23317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } }
I20260929 22:59:07.775213 23317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:59:07.776583 23291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d50dcec2e1a40ed939568c9c51e0694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2177bbed49f34bc6bddbd72ac819d583"
I20260929 22:59:07.776702 23291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:59:07.777482 23291 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d50dcec2e1a40ed939568c9c51e0694 in term 1.
I20260929 22:59:07.777802 23290 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [term 1 FOLLOWER]: Refusing update from remote peer 5d50dcec2e1a40ed939568c9c51e0694: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:59:07.778170 23440 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:59:07.780287 23443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.780376 23443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.780429 23443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d50dcec2e1a40ed939568c9c51e0694. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.780478 23443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:59:07.780510 23443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.780556 23443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:59:07.788988 23454 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:59:07.789043 23454 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:59:07.789497 23456 mvcc.cc:205] Tried to move back new op lower bound from 7334800374770937856 to 7334800374698754048. Current Snapshot: MvccSnapshot[applied={T|T < 7334800374770937856}]
I20260929 22:59:07.796608 23420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d50dcec2e1a40ed939568c9c51e0694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d50dcec2e1a40ed939568c9c51e0694" member_type: VOTER last_known_addr { host: "127.0.124.190" port: 34309 } } peers { permanent_uuid: "2177bbed49f34bc6bddbd72ac819d583" member_type: VOTER last_known_addr { host: "127.0.124.189" port: 33877 } } peers { permanent_uuid: "98f4cd9a157b4cb68ba2cfe0362c4a7a" member_type: VOTER last_known_addr { host: "127.0.124.188" port: 39201 } } }
I20260929 22:59:07.796707 23420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694 [sys.catalog]: This master's current role is: LEADER
I20260929 22:59:07.798518 23428 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:59:07.799278 23428 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:59:07.802963 23428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d50dcec2e1a40ed939568c9c51e0694: Generated new TSK 0
I20260929 22:59:07.803117 23428 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:59:07.835070 23397 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.833366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.0.124.188:39201)
0929 22:59:07.833411 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.833413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.834384 (+ 971us) server_negotiation.cc:407] Connection header received
0929 22:59:07.834504 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.834505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.834516 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.834546 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.834984 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33032: BlockingRecv error: recv got EOF from 127.0.0.1:33032 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 22:59:07.835949 23245 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.833780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36900 (local address 127.0.124.190:34309)
0929 22:59:07.833823 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.833825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.835455 (+ 1630us) server_negotiation.cc:407] Connection header received
0929 22:59:07.835550 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.835551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.835562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.835591 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.835892 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36900: BlockingRecv error: recv got EOF from 127.0.0.1:36900 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260929 22:59:07.836790 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.834115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42346 (local address 127.0.124.189:33877)
0929 22:59:07.834153 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.834155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.836306 (+ 2151us) server_negotiation.cc:407] Connection header received
0929 22:59:07.836400 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.836401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.836411 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.836439 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.836734 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42346: BlockingRecv error: recv got EOF from 127.0.0.1:42346 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:59:07.839228 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.838486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42360 (local address 127.0.124.189:33877)
0929 22:59:07.838518 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.838520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.838746 (+ 226us) server_negotiation.cc:407] Connection header received
0929 22:59:07.838846 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.838847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.838863 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.838892 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.839187 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42360: BlockingRecv error: recv got EOF from 127.0.0.1:42360 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:59:07.842218 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.841468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42366 (local address 127.0.124.189:33877)
0929 22:59:07.841507 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.841510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.841779 (+ 269us) server_negotiation.cc:407] Connection header received
0929 22:59:07.841868 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.841869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.841878 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.841905 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.842179 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42366: BlockingRecv error: recv got EOF from 127.0.0.1:42366 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:59:07.845988 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.845309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.0.124.189:33877)
0929 22:59:07.845338 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.845340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.845552 (+ 212us) server_negotiation.cc:407] Connection header received
0929 22:59:07.845649 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.845649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.845658 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.845684 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.845952 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42372: BlockingRecv error: recv got EOF from 127.0.0.1:42372 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260929 22:59:07.851810 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.851089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.0.124.189:33877)
0929 22:59:07.851120 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.851122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.851362 (+ 240us) server_negotiation.cc:407] Connection header received
0929 22:59:07.851449 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.851450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.851459 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.851485 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.851772 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42384: BlockingRecv error: recv got EOF from 127.0.0.1:42384 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:59:07.861625 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.860899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42396 (local address 127.0.124.189:33877)
0929 22:59:07.860930 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.860932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.861131 (+ 199us) server_negotiation.cc:407] Connection header received
0929 22:59:07.861220 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.861221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.861229 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.861255 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.861566 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42396: BlockingRecv error: recv got EOF from 127.0.0.1:42396 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260929 22:59:07.879722 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.878903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42406 (local address 127.0.124.189:33877)
0929 22:59:07.878942 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.878944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.879189 (+ 245us) server_negotiation.cc:407] Connection header received
0929 22:59:07.879284 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.879285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.879296 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.879322 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.879656 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42406: BlockingRecv error: recv got EOF from 127.0.0.1:42406 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:59:07.914175 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.913219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42410 (local address 127.0.124.189:33877)
0929 22:59:07.913263 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.913265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.913564 (+ 299us) server_negotiation.cc:407] Connection header received
0929 22:59:07.913671 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.913672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.913684 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.913714 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.914111 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42410: BlockingRecv error: recv got EOF from 127.0.0.1:42410 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:59:07.980412 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:07.979709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42416 (local address 127.0.124.189:33877)
0929 22:59:07.979787 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:07.979789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:07.979869 (+ 80us) server_negotiation.cc:407] Connection header received
0929 22:59:07.979910 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:07.979911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:07.979920 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:07.979984 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:07.980332 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42416: BlockingRecv error: recv got EOF from 127.0.0.1:42416 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260929 22:59:08.110270 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:08.109638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.0.124.189:33877)
0929 22:59:08.109707 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.109708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.109809 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:59:08.109856 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.109857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.109866 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.109930 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:08.110224 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42432: BlockingRecv error: recv got EOF from 127.0.0.1:42432 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260929 22:59:08.368378 23321 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:59:08.367690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42448 (local address 127.0.124.189:33877)
0929 22:59:08.367771 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.367773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.367787 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:59:08.367860 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.367861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.367871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.367912 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:59:08.368296 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42448: BlockingRecv error: recv got EOF from 127.0.0.1:42448 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:59:08.725971 23410 catalog_manager.cc:1259] Loaded cluster ID: 0b443960e15d4f87936f968b4753e971
I20260929 22:59:08.726043 23410 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: loading cluster ID for follower catalog manager: success
I20260929 22:59:08.726788 23410 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: acquiring CA information for follower catalog manager: success
I20260929 22:59:08.727031 23410 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 98f4cd9a157b4cb68ba2cfe0362c4a7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:59:08.789528 23454 catalog_manager.cc:1259] Loaded cluster ID: 0b443960e15d4f87936f968b4753e971
I20260929 22:59:08.789642 23454 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: loading cluster ID for follower catalog manager: success
I20260929 22:59:08.790448 23454 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: acquiring CA information for follower catalog manager: success
I20260929 22:59:08.790696 23454 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2177bbed49f34bc6bddbd72ac819d583: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:59:08.883896 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:08.881464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42464 (local address 127.0.124.189:33877)
0929 22:59:08.881586 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.881588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.881625 (+ 37us) server_negotiation.cc:407] Connection header received
0929 22:59:08.881660 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.881661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.881710 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.881776 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:08.881920 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.882396 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.883208 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.883396 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.883446 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:08.883614 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:08.883721 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:08.883778 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:08.883817 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:59:08.883833 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260929 22:59:08.888111 23531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:08.885716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33038 (local address 127.0.124.188:39201)
0929 22:59:08.885809 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.885811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.885821 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:59:08.885886 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.885887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.885940 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.886024 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:08.886119 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.886607 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.887328 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.887543 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.887615 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:08.887784 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:08.887885 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:08.887969 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:08.888007 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 22:59:08.888027 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73,"thread_start_us":42,"threads_started":1}
I20260929 22:59:08.892155 23531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:08.889766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33046 (local address 127.0.124.188:39201)
0929 22:59:08.889803 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.889805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.889882 (+ 77us) server_negotiation.cc:407] Connection header received
0929 22:59:08.889966 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.889967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.889976 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.890028 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:08.890175 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.890740 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.891577 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.891759 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.891808 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:08.891953 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:08.891974 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:08.892010 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:08.892069 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 22:59:08.892087 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:59:08.892867 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:08.889827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.0.124.189:33877)
0929 22:59:08.889876 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.889878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.890185 (+ 307us) server_negotiation.cc:407] Connection header received
0929 22:59:08.890281 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.890283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.890295 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.890351 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:08.890460 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.891179 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.892083 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.892369 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.892424 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:08.892639 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:08.892671 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:08.892725 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:08.892804 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:59:08.892820 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:59:08.894032 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:59:08.889673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36916 (local address 127.0.124.190:34309)
0929 22:59:08.889774 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0929 22:59:08.889776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:59:08.889891 (+ 115us) server_negotiation.cc:407] Connection header received
0929 22:59:08.890051 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:59:08.890053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:59:08.890104 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:59:08.890197 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:59:08.890396 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.891181 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.893223 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:59:08.893437 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:59:08.893519 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:59:08.893721 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:59:08.893797 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:59:08.893872 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:59:08.893924 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:59:08.893947 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":49,"threads_started":1}
I20260929 22:59:08.895599 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 23174
I20260929 22:59:08.901134 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 23249
I20260929 22:59:08.906009 498 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ2hK39/build/release/bin/kudu with pid 23324
2026-09-29T22:59:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2822 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5604 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (265339 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST